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Preface 


It is well-known that Control Theory was founded by N. Wiener in 1948 
((B49]). After that, this theory was greatly extended to various complicated 
setting and widely used in sciences and technologies. Particularly, the rapid 
development of Control Theory began in the mid 1950's, partially in response 
to practical problems in many branches of engineering and economics. 

Roughly speaking, Control Theory can be divided into two parts. The first 
part is control theory for deterministic systems, and the second one is that for 
stochastic systems. Of course, these two parts are not completely separated 
but rather they are inextricably linked each other. 

Control theory for deterministic systems can be again divided into two 
parts. The first part is control theory for finite dimensional systems, main- 
ly governed by ordinal differential equations, and the second one is that for 
(deterministic) distributed parameter systems, mainly described by differen- 
tial equations in infinite dimensional spaces, typically by partial differential 
equations. 

Control theory for finite dimensional systems is by now relatively mature. 
Classics in the field include, among others, the three milestones of modern con- 
trol theory, i.e., L. S. Pontryagin's maximum principle ([281]), R. Bellman's 
dynamic programming method ([20]), and R. E. Kalman's optimal linear reg- 
ulator theory ([IG3]). We refer to M, 28, B7, 45, 59, (102, IT93], just to mention 
a few, for some of the subsequent progresses. 

There exist a huge list of works on control theory for distributed parameter 
systems, and it is still quite active. Pioneers in this field include A. V. Bal- 
akrishnan (([9]), A. G. Butkovskii ([44]), Yu V. Egorov ([R5]), H. O. Fattorini 
(Œ), C. C. Kwan and K. N. Wang ([I83]), J.-L. Lions ([2U5]), D. L. Russell 
((292]), P. K. C. Wang ((B43]) and so on. For early books on this topic, we 
mention WA, 66, ZU5]. For the extensive works in the recent three decades, we 
refer to M, I0, 61, 67, 88, 92, TOM, LO, CG, 117, 123), 1244), IT63, C0, CA, C80, 
199, 202), 220, B05, 820, 323, B25) B39, B89, B95, B96) and the rich references 
cited therein. 


VI Preface 


Likewise, control theory for stochastic systems can be divided into two 
parts. The first part is control theory for stochastic finite dimensional systems, 
governed by stochastic (ordinary) differential equations, and the second one 
is that for stochastic distributed parameter systems, described by stochastic 
differential equations in infinite dimensions, typically by stochastic partial 
differential equations. 

One can also find a huge list of publications on control theory for stochastic 
finite dimensional systems and its applications (say, in mathematical finance). 
Pioneers in this field include R. Bellman ([2]]), W. H. Fleming and M. Nisio 
(E), J. J. Florentin ([I00]), H. J. Kushner ([U77]) and so on. For early books 
on this topic, we mention [6], [29] and [L79]. For the extensive (and/or closely 
related) works in this respect in the recent decades, we refer to |B, 27, 48, 52, 
53, 98, (24, [L73, (RT, 204, 250, 272, 279, B22, B40, B63, BEJ, B71, BS3] and 
the rich references cited therein. Nevertheless, most of the existing works in 
this respect are mainly addressed/related to optimal control problems. As we 
shall see in Chapter Bl (of this book), so far controllability theory for stochastic 
finite dimensional systems is NOT well-developed. 

By contrast, control theory for stochastic distributed parameter systems, 
is, in our opinion, still at its very beginning stage. Indeed, though one can 
find a considerably number of papers (See BA, BU, 9U, 96, [L78, BUA, B26] for 
the early ones) and five related books (15, B9, (167, 242, 259) T (See also the 
books [66, 270] for several related chapters) on this topic, as far as we know, 
there exist no any monographs addressing systematically to this rather new 
branch of mathematical control theory, which is actually the main concern of 
this book. 

One of the most essential difficulties in the study of control theory for 
stochastic distributed parameter systems is that, compared to the determin- 
istic setting, people know very little about stochastic evolution equation (and 
particularly, about stochastic partial differential equations) although many 
progresses have been made there (See |G8, [L38, (137, (145, 157, 829, B35), 
etc.). On the other hand, as we shall see in the context of this book, both 
the formulation of stochastic control problems in infinite dimensions and the 
tools to solve them may differ considerably from their deterministic/finite- 
dimensional counterparts. Because of this, one has to develop new mathemat- 
ical tools, say, the stochastic transposition method introduced in our works 
PZI, (242, Z4, 245, 248] (See also Chapters Hl and ZHE, and particularly 
Section L4 of Chapter [Il for more details and explanations), to solve some 
problems in this field. 

In some sense, the stochastic distributed parameter control system is the 
most general control system in the framework of classical physics, and there- 
fore the study of this field may provide some useful hints for that of quantum 
control systems. 


! Actually, the books [L53, 167, 259) addressed mainly to some slightly different 
topics. 


Preface VII 


This book is an introduction to (mathematical) control theory for stochas- 
tic distributed parameter systems. Our aim is to provide a basic reference for 
both beginners and experts who are interested in this challenging, vigorous 
and fascinating field. It is designed for a reader having some basic knowl- 
edge of functional analysis, partial differential equations and control theory 
for deterministic systems but not being familiar with probability theory and, 
particularly, stochastic analysis. 

'The authors would like to take this opportunity to thank Professors Shup- 
ing Chen, Jean-Michel Coron, Héléne Frankowska, Xiaoyu Fu, Andrei Fur- 
sikov, Zechun Hu, Oleg Yu. Imanuvilov, Gilles Lebeau, Xu Liu, Shige Peng, 
Luc Robbiano, Shanjian Tang, Emmanuel Trélat, Jan van Neerven, Gengsheng 
Wang, Tianxiao Wang, Zhongqi Yin, Jiongmin Yong, Bingyu Zhang, Haisen 
Zhang and Enrique Zuazua for collaborations/comments/discussions/encour- 
agement/supports during the preparation of this book. This work is partially 
supported by NSF of China under grants 12025105, 11971334, 11931011 and 
11221101. 


Chengdu, China Qi Lü 
Chengdu, China Xu Zhang 
June 30, 2020 
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Introduction 


In this chapter, we expound the necessity, novelty, importance and challenge 
to study stochastic distributed parameter control systems. We also illustrate 
pedagogically the main problems to be considered and the main methods to 
be employed in this book. 

Throughout this book, N, Z, Q, R and C stand for respectively the set 
of positive integers, integers, rational numbers, real numbers and complex 
numbers. Also, we shall denote by C a generic positive constant which may 
change from line to line (unless other stated). 


1.1 Why Stochastic Distributed Parameter Control 
Systems? 


After N. Wiener's classical work ([849]), owing to the great effort of numer- 
ous mathematicians and engineers, Control Theory has grown into a new 
discipline— Control Science. Mathematical control theory, an active branch of 
applied mathematics, which aims to provide the mathematical foundations for 
Control Science, refers to mathematical theory and methods for the analysis 
and design of control systems. Stimulated by the seminal works [20, 163, 2&1], 
rapid development of mathematical control theory (for both deterministic and 
stochastic systems) began in the 1960s. Usually, in terms of the state space 
method (e.g., [[63]), people describe the control system under consideration 
as a suitable state equation. 

The main concern of this book belongs to a new branch of mathematical 
control theory, i.e., control theory for stochastic distributed parameter sys- 
tems, that is, systems governed by stochastic differential equations in infinite 
dimensions, including stochastic differential equations with delays, stochas- 
tic partial differential equations, random partial differential equations (i.e., 
partial differential equations with random parameters), and so on. 

One may ask a natural question, i.e., why should people study stochas- 
tic distributed parameter control systems? Our answer is, this is because, for 
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2 1 Introduction 


Control Theory, it is now stochastic distributed parameter control systems’ 
turn! Let us justify it below by recalling rapidly the history of modern control 
theory (particularly mathematical control theory, of course). 

Since the middle of 1950s, the rapid development of space technology re- 
quests urgently to solve the control problems such as launching the rockets, 
satellites, etc. into the pre-selected orbit accurately with the minimum fuel 
consumption or in the shortest flight time. These control problems are too 
complex to be solved by the classical control theory developed in [B49]. By 
the early 1960s, a set of new principles and methods, which are based on 
the state space method to analyze and design the control system, has been 
established. This marks the formation of modern control theory (and also 
mathematical control theory). Three milestones therein are achieved by L. 
Pontryagin (Pontryagin's maximum principle, [281]), R. Bellman (Bellman’s 
dynamic programming method, [20]) and R. Kalman (Kalman’s filtering and 
linear quadratic optimal control, [I62, IIG3]). Note that these classics are ad- 
dressed mainly to finite dimensional control systems, which are governed by 
ordinary differential (or difference) equations. Inspired by Pontryagin, Bell- 
man and Kalman's works, starting from 1960s there are numerous publications 
addressing to this topic. Now, control theory for finite dimensional systems is 
relatively mature though many problems in this field are still remained to be 
done. 

Fundamentally, all physical systems are intrinsically distributed in nature. 
Actually, for practical problems, finite dimensional systems are only approxi- 
mations of distributed parameter systems (i.e., infinite dimensional systems) 
to a certain extend. Therefore, theoretically distributed parameter systems 
are more realistic models. As for concrete applications, although it seems that 
approximate models have more significance in view of engineering (especially 
by considering computer implementation), the study on more realistic models 
contributes to giving reasonable approximate models, and particularly giving 
reasonable control laws, from the point of view of Control Theory. Distributed 
parameter control systems are control systems described by differential equa- 
tions in infinite dimensional spaces, for example, partial differential equations, 
delay differential equations, etc. 

Control theory for distributed parameter systems originated in the 1960s, 
and the early works on this field were mainly done by A. G. Butkovskii (|H4]), 
Yu V. Egorov ([RS5]), H. O. Fattorini ([91]), J.-L. Lions ([2U5]), D. L. Russell 
((292]), P. K. C. Wang ([EX3]) and so on. In the past nearly 60 years, this 
theory has been developed very rapidly, for which more than one hundred 
monographs and thousands of research papers have been published one after 
another. So far, there exists no sign of slowing growth of this field. In the recent 
two decades, many new tools are introduced/refined, and lots of breakthroughs 
are obtained in this respect. We refer the readers to [45 46, 29, 62, 65, ES, 
95, ITTO, CA, 123, (033), A, [TGS, L0, (E72, Ra, 99, 200, 220, Z88, BUS, 823, 
B25, B33, B38, BSS, B95 BIG) and the references therein for the development 
of control theory for distributed parameter systems in the new century. 
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The world is full of uncertainties, and therefore it is impossible to pre- 
dict accurately the future, just like “a storm may arise from a clear sky". 
'Therefore, studying random phenomena from the viewpoint of Control The- 
ory, without doubt, has basic, important scientific significance and practical 
values. Strictly speaking, any real system contains various random factors, but 
these factors may be ignored in many situations. However, when these factors 
cannot be ignored, the behavior of the control system, if designed according 
to the deterministic control theory, would deviate from the expected design 
requirements, and sometimes it may even happen that, as a Chinese proverb 
said, “Cha Zhi Hao Li, Shi Zhi Qian Li”, i.e., “an error, the breadth of a single 
hair, can lead a thousand li astray". 

Control theory for stochastic finite dimensional systems originated in the 
late 1950s, which has developed very rapidly for the past (more than) 60 years. 
The early works on this field were mainly accomplished by R. Bellman, W. H. 
Fleming, H. J. Kushner, M. Nisio, etc. ([2T, 92, [77]). Thanks to J.-M. Bismut 
([3]), W. H. Fleming ([9G]), P.-L. Lions (B, ZTT, 2T2]), S. Peng ([Z73]) 
and so on, deep studies in this respect have been done (see [9&8, L73, BAJ). 
An important byproduct in the study of this field is the appearance of a 
new theory, i.e., backward (or more generally, forward-backward) stochastic 
differential equations (see [B3, Z5I, ZTI]), which is by now widely used in 
financial mathematics, stochastic analysis, partial differential equations, etc. 
(e.g., B8, Z3, BG, Z50, 274, B21). 

Now, we are in a position to return to the main topic of this book, i.e., 
control theory for stochastic distributed parameter systems. Theoretically, 
motivated by the success of control theories for finite dimensional systems, 
distributed parameter systems and stochastic finite dimensional systems, as a 
natural development, people hope to study stochastic distributed parameter 
control systems. Indeed, soon after the publication of early works on stochas- 
tic finite dimensional control systems, some pioneers including A. Bensoussan 
[24], M. Kh. Bikchantayev ([|BU]), P. L. Falb ([80]), W. H. Fleming ({96]), H. J. 
Kushner ([L78]), T. K. Sirazetdinov ([BU2]), G. Tzafestas and J. M. Nightin- 
gale ((B26]) and so on began the study of stochastic distributed parameter 
control systems. On the other hand, in the application aspects, because of 
the inherent complexity of the underlying physical processing, many control 
systems in reality (such as that in the microelectronics industry, in the at- 
mospheric motion, in communications and transportation, and so on) exhibit 
very complex dynamics, including substantial model uncertainty, actuator and 
state constraints, and high dimensionality (usually infinite). These systems are 
often best described by stochastic partial differential equations or even more 
complicated stochastic equations in infinite dimensions (e.g., [263]). 

In our opinion, the field of stochastic distributed parameter control systems 
is far from mature till now, in which many aspects are much less-understood 
or even still blank, compared to the deterministic setting and/or stochastic 
finite dimensional problems. More precisely, we mention the following issues. 
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Compared to the deterministic cases (for both finite dimensional and dis- 
tributed parameter control systems), the study of stochastic controllabil- 
ity/observability is quite unsatisfactory, even for the setting of stochas- 
tic finite dimensional control systems (see Chapter B for a more detailed 
analysis). Indeed, so far there exists no nontrivial controllability result 
for stochastic nonlinear systems. Also, for most of positive controllability 
results (in the existing literatures, e.g., ZZ, Z3T, 247, BI»]) for stochas- 
tic partial differential equations, controls are introduced into the diffusion 
terms and are assumed to be active everywhere. 

In order to derive Pontryagin-type maximum principle for general nonlin- 
ear stochastic distributed parameter control systems, the key in [242] is 
to introduce the notion of relaxed transposition solutions to an operator- 
valued backward stochastic Lyapunov equation, and via which the well- 
posednss of such an equation can be established. Although this notion 
of solutions and its modification are useful and enough to tackle several 
different problems (say, the first and second order necessary condition- 
s for optimal controls of general nonlinear stochastic evolution equations 
in infinite dimensions ([I033, 104, 240, 242, 244, 245]), characterization of 
optimal feedback operators for general stochastic linear quadratic control 
problems (with random coefficients) in infinite dimensions (|235, 248)), 
etc.), it is much better to show that the underlying operator-valued back- 
ward stochastic evolution equations are well-posed in a stronger sense, i.e., 
in the sense of transposition solutions rather than relaxed transposition so- 
lutions (See Chapters [I2-IT3 for more details), which remains an unsolved 
problem. 

'The extension of Bellman's dynamic programming method to the stochas- 
tic setting, though some very interesting and important progresses were 
made (B9, ZT3, ZI4]), the problem is far from well-understood for the 
systems with random coefficients, even in the setting of stochastic finite 
dimensional control systems. Indeed, as far as we know, in this case, one 
has to face a challenging problem to establish the well-posednss of back- 
ward stochastic Hamilton-Jacobi-Bellman equations. 

In order to find optimal feedback operators for stochastic linear quadratic 
control problems (with random coefficients) in infinite dimensions, one has 
to solve suitable operator-valued backward stochastic Riccati equations. 
However, so far the well-posedness of this sort of Riccati equations is known 
only for some very special case, again even in the setting of stochastic 
control systems in finite dimensions (|248]). 


Consequently, control theory for stochastic distributed parameter systems is 
still at its very beginning stage, though after the development of more than 
50 years. Compared with other directions in mathematical control theory (in- 
cluding control theory for finite dimensional systems, that for distributed pa- 
rameter systems and that for stochastic finite dimensional systems), at this 


moment it is an “ugly duckling 
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One will meet many substantially difficulties in the study of control prob- 
lems for stochastic distributed parameter systems, for example: 


e Unlike the deterministic setting, the solution to a stochastic evolution 
equation (even in finite dimensions) is usually non-differentiable w.r.t. the 
variables with noises. 

e The usual compactness embedding result fails to be true for solution spaces 
related to the stochastic evolution equations under consideration. 

e The "time" in the stochastic setting is not reversible, even for stochastic 
hyperbolic equations. 

e Generally speaking, stochastic control problems cannot be reduced to de- 
terministic ones. 


Actually, the main difficulty in this field lies in the fact that, as we shall see in 
the rest of this book, one has to develop new mathematical tools even for some 
very simple stochastic distributed parameter control systems. Indeed, many 
tools and methods, which are effective in the deterministic case, do not work 
anymore in the stochastic setting. Technically, the most essential difficulty in 
the field of stochastic distributed parameter control systems, is the very fact 
that the theory of stochastic partial differential equations itself is far from 
mature (though significant progress has been made there in recent years, e. 
g., E30, C37). This can be seen even from the title of J. Glimm's review article 
([L22]): Nonlinear and stochastic phenomena: the grand challenge for partial 
differential equations. 

We think, control theory for stochastic distributed parameter systems is 
a direction which deserves to be developed with great efforts in the whole 
Control Science, especially in mathematical control theory. Clearly, in the 
framework of classical physics, the stochastic distributed parameter system 
is very likely the most general control systems. A deep study on this topic 
may provide some useful hints for the development of mathematical theory 
for quantum control systems. 

In conclusion, the field of stochastic distributed parameter control systems 
is full of challenging problems, which offers a rare opportunity for the new 
generations in Control Theory. Definitely, we believe that control theory for 
stochastic distributed parameter systems will become a “white swan” in the 
near future! 


1.2 Two Fundamental Issues in Control Theory 


Roughly speaking, “control” means one can change the dynamics of the in- 
volved system, by means of a suitable way. By our understanding, there are 
at least two fundamental issues in Control Theory®, i.e., feasibility and opti- 
mality, which will be explained more below (c.f. [220]). 


1 We refer the readers to [889] for more fundamental issues in Control Theory. 
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'The first fundamental issue in Control Theory is feasibility, or in the ter- 
minology of Control Theory, controllability, which means that, one can find 
at least one way to achieve a goal. More precisely, for simplicity, let us consid- 
er the following controlled system governed by a linear ordinary differential 
equation: 


l y(t) = Ay(t) + Bu(t), a.e. t€ [0, T], 
(1.1) 


y(0) = yo. 


In (ILI), A € R?*", B € R?*" (n,m EN), T > 0, y(-) is the state variable, 
u(-) is the control variable, and R” and R™ are respectively the state and 
control spaces. We begin with the following notion (More notations/notions, 
which may be used below, will be given in Chapter Ø): 


Definition 1.1. The system (TI) is called exactly controllable (at time T) 
if for any initial state yo € R” and final state yı € R”, there is a control 
u(-) € L! (0, T; R") such that the solution y(-) to (I) satisfies 


y(T) =m, (1.2) 
i.e., the control u(-) transfers the state of (LL) from yo to yı at time T. 
One has the following result: 


Theorem 1.2. ([IG3]) The system (TI) is exactly controllable at time T if 
and only if the following Kalman rank condition holds 


rank [B, AB, --- , A^ 1 B] =n. (1.3) 


In the sequel, denote by B! the transpose of B, and write 
D a 
Gp = n e^ RB e^ tdt. (1.4) 
0 


One can show the following further result: 


Theorem 1.3. ([IG63]) 7f the system (TT) is exactly controllable at time T, 
then det Gr Z 0. Moreover, for any yo,y1 € R”, the following control of 
explicit form: 

u(t) = —BT'e^' T-9 G5! (eAT y, — y) (1.5) 


transfers the state of (TI) from yo to yı at time T. 


The proof of Theorems [L2HL 3 will be given in that of Theorem (in 
Section C3). 


Remark 1.4. Unlike most of the previous literatures, in Definition L] we de- 
liberately choose the control class to be L!(0, T; IR"). From Theorem IL3, it 
is easy to see that, if (LI) is exactly controllable at time T (by means of 
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L1-(in time) controls), then the same controllability can be achieved by using 
analytic-(in time) controls. Actually the same can be said for the case that 
the control class L!(0, T; IR") in Definition L] is replaced by L?(0, T; R”) 
for any p € [1,oo]. However, in Chapter B, we shall see a completely different 
phenomenon even in the simplest stochastic situation. 


'The above definition of controllability can be easily extended to both deter- 
ministic and stochastic systems (See Definition EU in Chapter Bl for a general 
formulation of controllability). In the general setting, it may happen that the 
requirement (ILZ) has to be relaxed in one way or another. This leads to the 
notions of approximate controllability, null controllability, partial controlla- 
bility, and so on. Also, the above B can be unbounded (in a suitable way) for 
general controlled systems. 

Controllability is strongly related to (or in some situation, even equivalent 
to) other important issues in Control Theory, say observability, stabilization 
and so on. One can find numerous literatures on these topics (e.g., |M, 14, Æ, 
AY, 61, 62, LA, L54, 163, (89), IT9U, C99, 207, ZSA, 295), HSS, B95, B96) and rich 
references therein). 

One of the main concerns in this book is to study controllability prob- 
lems for stochastic evolution systems, in particularly that for several typical 
stochastic partial differential equations. 

The second fundamental issue in Control Theory is optimality, or in the 
terminology of Control Theory, optimal control, which means that people are 
expected to find the best way, in some sense, to achieve their goals. As an 
example, we fix yo € R”, a subset S of R”, a suitable nonlinear function 
f: [0,7] x R” x R” > R” and a given nonempty subset U of R”, and 
consider the following controlled system: 


m = f(t, y(t),u(t)), ae. t € [0, T], 
(1.6) 
y(0) = yo, 


where y(-) is the state variable and u(-) is the control variable, valued in R” 
and U, respectively. It is easy to see that, if there exists a control u(-) € 
U 2t) : (0,7) > U | v(-) is (Lebesgue) measurable} such that the solution 
y(-) € C([0, T]; IR?) to (LU) satisfies 


y(T) € 8, (1.7) 


then, very likely, one may find another control verifying the same conditions. 
Naturally, one hopes to find the “best” control fulfilling these conditions. To 
be more precisely, we fix two suitable functions g(-,-,-) : [0, T] x R” x R^ > R 
and h: R” — R, and denote by Uaa the set of controls u(-) € U so that the 
solution y(-) to (CG) satisfies (I7) and g(-, y(-), u(-)) € L' (0, T). Suppose that 


Uaa # Í, (1.8) 
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and introduce the following cost functional: 


T 
J(u()) = f a(t,y(t),u(t)dt + RUT), uC) EUa: (19) 


A typical optimal control problem for the system (ILH) is to find a u(-) € Una, 
called an optimal control, which minimizes the cost functional (CQ), i.e., 
J(uC) — inf J(u()). (1.10) 
u(-) € Uaa 
The corresponding solution to (LA) is denoted by g(-), and (g(-), u(-)) is called 
an optimal pair. 

The simplest case is S = R™, which means that there is no constraint on 
the final states of ([LG). For this case, people introduce the Hamiltonian as 
follows: F 

A(t, y, u, p) c (p, f (ty, u))gs — (t y, u), 
(t, y,u, p) € [U, T] x R” x U x R”. 
Then, one can show the following Pontryagin Maximum Principle ([Z8T]): 
Theorem 1.5. Let S = R™ and (g(-), u(-)) be an optimal pair. Then 


H(t, g(t), u(t), p(t)) = max H(t, (t), u, p(t)), a.e. t € [0, T], (111) 


where p(-) : [0, T] — R” solves 


e TUAM SUN Bere th (1.12) 


Remark 1.6. Thanks to Pontryagin’s Maximum Principle, the optimization 
problem (ILTU) (which is usually infinite dimensional) is reduced to a finite 
dimensional optimization problem (L) (in the pointwise sense). Since The- 
orem [LJ can be viewed as a special case of Theorems or [LZ Tin Chapter 
I, we will not prove it in here. Instead, in the next section we shall prove a 
linear quadratic version of this theorem, and via which we emphasize the dif- 
ficulty to formulate the stochastic version of the “backward” equations (L2) 
and (LA) (in Section C3). 


The above optimal control problem can be easily extended to more general 
setting (See Problem (SOP) in Section of Chapter Bl for a general formu- 
lation of stochastic optimal control problems), particularly for the case that 
the controls take values in a more general set (instead of a subset of R”), 
say any metric space, which does not need to enjoy any linearity or convexity 
structure. 

Optimal control problems are strongly related to the classical calculus of 
variations and optimization theory. Nevertheless, since the control class may 
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be quite general, the classical variation technique cannot be applied to optimal 
control problems directly. Various optimal control problems are extensively 
studied in the literatures (e.g., D, 5, 20, 27, ZA, 59, 64, 99, (002, C59, 163, LZ, 
86, 202, 2UG, 242, ZST, B23, B71} and rich references cited therein). 

Another main concern in this book is to study optimal control problems for 
stochastic evolution systems in infinite dimensions, including Pontryagin-type 
Maximum Principle for the general setting and characterization of optimal 
feedback operators for linear quadratic optimal control problems. 

It is easy to see that, the study of controllability problems is a basis to 
investigate further optimal control problems. Indeed, the usual nonempty as- 
sumption on the set of feasible/admissible control-state pairs for optimal con- 
trol problems (say, Uaa # @ in (ILS)) is actually a controllability condition. 
Nevertheless, in the previous literatures, it seems that the studies of control- 
lability and optimal control problems are almost independent. A few typical 
exceptions that we know are the following: 


1) In [154], some techniques from optimal control theory are employed to 
derive the observability estimate and null controllability for parabolic type 
equations. 

2) In [838], some techniques developed in the study of controllability and 
observability problems are adopted to solve several time optimal control 
problems. 

3) Very recently, in [220], a new link between (finite codimensional exact) con- 
trollability and optimal control problems for general evolution equations 
with endpoint state constraints is presented. 





In our opinion, it is now the time to solve controllability and optimal 
control problems as a whole, at least in some sense and to some extent, though 
they are two quite different issues in Control Theory. This is by no means 
an easy task. Actually, for many concrete problems, it is highly nontrivial 
to verify the above mentioned assumption that the set of feasible/admissible 
control-state pairs is nonempty, even in the setting of finite dimensional control 
systems. 

In this book, we shall try to present the existing theory on controllability 
and optimal control for stochastic distributed parameter systems in a unified 
manner, at least from the perspective of methodology. Indeed, as we shall 
explain in the next section, throughout this book we shall systematically use 
the duality argument. 


1.3 Range Inclusion and the Duality Argument 


Clearly, any controllability problem (formulated in Definition L] or more gen- 
erally, in Definition in Chapter El) can be viewed as an equation problem, 
in which both the state x(-) and the control u(-) variables are unknowns. 
Namely, instead of viewing u(-) as a control variable, we may simply regard 
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it as another unknown variable. One of the main concerns in this book is to 
study the controllability problems for linear stochastic evolution equations. 
As we shall see later, this is far from an easy task. 

It is easy to see that, in many cases solving linear equations are equivalent 
to showing range inclusion for suitable linear operators. Because of this, we 
shall present below two known range inclusion theorems (i.e., Theorems LCA 
and [ET below) in an abstract setting. 

Throughout this section, X,Y and Z are Banach spaces. Denote by 
£(X;Y) the Banach space of all bounded linear operators from X to Y, 
with the usual operator norm. When X = Y, we simply write £(X) instead 
of £(X; X). For any L € L(X; Y), denote by R(L) the range of L. We begin 
with the following result. 


Theorem 1.7. Let F € L(X; Z) and G € L(Y; Z). The following assertions 
hold: 
1) If R(F) 2 R(G), then there is a constant C > 0 such that 


IG*e*lys < CIP*z^|x«, Va*ez*. (1.13) 


2) If X is reflexive and (LIA) holds for some constant C > 0, then R(F) 2 
R(G). 


Proof: 1) We use the contradiction argument. Suppose (IL T3) did not hold. 
Then, for each n € N, we could find z* € Z* such that 


1 
|F* 2" | ye < —|G* 2% lv». (1.14) 
n 
From (LA), G*z* z 0. Define 
> vn * 


-————— > 1. 1.15 
en |G*zž |y» Žns na ( ) 
Then, 
5 Jn 
F* Z| ye = | F* 2 | xe < — > 0, 
ERI GETA a vn as n — oo. (1.16) 


|G* Z% |y» = Vn — Ow, 


On the other hand, for any y € Y, there exists x € X such that Gy = Fr. 
Thus, 
(Gz yy Y = (5. GY) z=, Z = (2, Fx)z«z a 17) 
= (F* 2 , £) x» x 30, n oo. 


? Nevertheless, the resulting equation is NOT well-posed, or even highly ill-posed. 
Indeed, generally speaking, none of the existence, uniqueness and continuous de- 
pendence for such an equation can be guaranteed. 
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This means that, for each y € Y, (G*2*)(y) tends to 0 as n — +00. Hence, 
by the Principle of Uniform Boundedness, the sequence {G*Z*},en must be 
uniformly bounded, contradicting the second assertion in (ZIM). 


2) Fix a y € Y , define a functional f on R(F*)(C X*) as follows: 
f(a*) = (y, G*2*)vys, Vz* € Z*, with z* = F*z*. (1.18) 
For any 2}, 25 € Z* with F*z{ = F*z3, by (LT), 


[G (zi — ay. x C[F (at — 22) 





Js X* — 0, 


which implies that f is well-defined. Clearly, f is linear and, by (IL T3) again, 
|f (2*)| = Ky, G* )v.v*| < lylv |G* 2" 
€ Clylv |F*2"|x+ = Clylv |z*] x». 





Y* 


Hence, f is a linear bounded functional on R(F*), with the norm inherited 
from X*. By the Hahn-Banach Theorem and the reflexivity of X, we can find 
x € X** = X such that 


f(a*) = (a*, £) x+, xX, Vz* € R(F*). (1.19) 
Consequently, by (LIS) and (ILT9), 
(2*, Gy)zsz = GG  Z)y ys = f(x*) = (2*, £) x*,x 
—(F'zumx)xex =(2",F2)g2, V2 eZ. 


Hence, Gy = Fx and therefore, R(G) C R(F). This completes the proof of 
Theorem CA. O 


Remark 1.8. By Theorem [L4 it is easy to see that, if X is reflexive, then, for 
some constant C > 0, 


IG*z*tly« € C|F*z*|x«, Vz € Z^ — R(G)CR(F). (1.20) 
As shown in [365], the equivalence (ILZU) may fail whenever X is not reflexive. 


In this book, we shall need a range inclusion theorem in which X is NOT 
reflexive. In this case, instead of the reflexivity assumption for X, people 
assume the surjection condition for G, and then show that the equivalence 
(CZO) remains true. In order to establish such an equivalence, we need the 
following result, which is an easy consequence of [291], Theorem 3.4, p. 58]. 


Lemma 1.9. Suppose that O1 and Os are two disjoint closed convex sets in 
X, and O; is compact. Then, there exists a real-valued functional f € X* and 
two constants a, B € IR, such that 


sup (£, f) y x« «o « B « sup (x, f) x x» 
xe r€O»5 
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The following result holds: 
Theorem 1.10. If F € L(X; Z), GE L(Y; Z) is surjective and (LTA) holds 


for some constant C > 0, then 
G(By) C CF(Bx) = (CFz | x € Bx}, (1.21) 


where Bx and By are respectively the open unit balls in X and Y , and hence 
R(F) 2 R(G). 


Proof: We first claim that 


F(By) 2 5605»). (1.22) 


If the above was not true, then we could find some yo € Y with |yoļly < c 


such that Gyo ¢ F(Bx). By Lemma LY, one can find a real-valued functional 
C* € Z* and two constants a, 8 € R, such that 


(Gyo, C zz aos p< (5C )zze Vz& F(Bx). 


'This implies that 


(z, =¢* ) zz =p e eise (Gyo, —C* )z ze Vz€ F(Bx). 
Noting 0 € F(Bx), we then see that —8 > 0. Hence, after suitable scaling, 
for some z* € Z*, we have 


(2,2" )gg.€1«(GyezZ )gz. Vz€F(Bx). 





Further, F(Bx) is symmetric w.r.t. the origin. Thus, the above also implies 
lez )zzlzi«(Gwz')zz. YZE F(Bx). 
Consequently, 
(£, Bz") y x| = Fa, 2")z z| <1, Vzr€Bx, 


which yields |F*z*|,. < 1. Hence, by (£13), we arrive at 








C < al ( Gyo, z daze = co € vA )yy- 
1 * ok * ok 
< C lyoly IG* z*|,.. < lyoly |F*z*|x. < |yoly » 


which is a contradiction. This proves (ILZ2). 


Further, we claim that 
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F(Bx) 2 5G(By). (1.23) 


To show this, for each y € Y and e > 0, let us find xz € X such that 
Izx €Clyly,  |Gy—Falz <e. (1.24) 


This can be achieved as follows: If y = 0, we simply choose x = 0. Otherwise, 


consider v — u Clearly, |v|,, = 1 and v € By. Note that, by (ILZ2), we 


have 





F(Bx) 2 $G(8y) 2 $608). 
Hence, there is a u € CBx such that |Gv — Fu|7? < viz Now, let us put 
x = |yly u. We then have (LZA). 

Clearly, ker G = (y € Y | Gy = 0} is a closed subspace of Y. Denote by Y 
the quotient space Y/ ker G, which is a Banach space with the usual quotient 
norm. Since G is surjective, the operator G : Y — Z defined by 





GiytkerG)=G(y), Vy €Y, 


is a bijective bounded linear operator from Y onto Z. Now, fix any yı € By. 


Pick €, > 0 so that 
oo 
p «1—- lily - 
n=1 


Assume for n > 1, yn is picked. By (LZA), there is x, such that |æn| y € C |ynly 


and |Gyn — Fz«|z < angi... Let us define 9,41 € Y by 
L(Z;¥) 


Gn41 = G7! (Gyn — Fan). 
Then, one may find yn+1 € Y so that 
GYn+1 = Gyn x Fr, 
Iunaalv < 2|ds41lg < AIG" lec. [Gyn EE Frnlz < £n. 


By induction, this process defines two sequences {x,} C X and {yn} C Y. 
Note that 
legal <C a pily < CEn- 


Hence, 
oo oo oo 
M lanlx € nix + do en <C lily +C) en «C. 
n=1 n=1 n=l 


It follows that x = 5 £n is in CBy and that 


n=1 
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N N 
Fr— li Fa, = li = = 
z RO. Ln jim, 2 (Gus Gyn41) = Gun, 


since yy+1 — 0 as N > oo. Thus Gy; = Fx € CF(Bx), which proves (023). 
Finally, R(F) 2 R(G) follows immediately from ([LZ3). This completes 
the proof of Theorem (LIU. Oo 


Remark 1.11. Clearly, by Theorem [L IU and the first assertion in Theorem LA, 
we see that the equivalence (CZU) holds whenever G is surjective (even without 
the reflexivity assumption for X). Also, the inclusion relationship (CZD) in 
Theorem LIQ provides a “quantitative” characterization on R(F) 2 R(G). 
Such a characterization is sometimes useful (e.g., [239]). 


We shall also need the following result. 


Theorem 1.12. Let F € L(X; Z). Then R(F) = Z if and only if 


F*z* — 0 for some z* € Z* > z* — Q0. (1.25) 


Proof: The “if? part. We use the contradiction argument. If R(F) = Z 
was not true, then we could find some nonzero zo € Z such that zo ¢ R(F). 
By Lemma ICY, similarly to that in the proof of Theorem LIO, one can find a 
nonzero z* € Z* with (29,2*)z 7» = 1 such that 


(5zZ )gzg.-0, VzER(F). 
Consequently, 

(Fz,z')g2.—0, Vm eX, (1.26) 
which implies that F*z* = 0. But this, by (ILZ53), leads to z* = 0, a contra- 
diction. 


The “only if? part. Suppose that F*z* = 0 for some z* € Z*. Then, it is 
easy to see that (L2G) holds. This, combined with R(F) = Z, indicates that 
g* Q0. L1 





The key in Theorems [L7 and [LTU is to reduce the problem of range in- 
clusion (i.e., R(F) 2 R(G)) to the majorization of dual operators, i.e., the 
estimate (LIJ) (See also Theorem LIA). Such a method, i.e., solving the 
problem under consideration via its dual one, is classical, called the duality 
argument. 

Inspired by the study of deterministic control problems (especially these 
for deterministic partial differential equations), in this book we shall employ 
the above range inclusion theorems and the duality argument to handle the 
controllability problems and optimal control problems for stochastic evolution 
equations 

'To explain the idea, in the rest of this section, we shall focus on the simplest 
control system, i.e., the system (LI) (governed by a linear ordinary differential 
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equation), and show how to apply the above mentioned method to solve the 
exact controllability problem and an optimal control problem for such a system 
by means of its dual problem. 

To analyze the exact controllability for (LI), people introduce the fol- 
lowing dual equation (of (ILT)), which is a (backward) ordinary differential 
equation: 


F =—A'z in [0, T], 
(1.27) 


z(T) =z, ER”. 
We have the following result (which implies Theorems [L2HL3): 


Theorem 1.13. The following five statements are equivalent: 


1) The system (LI) is exactly controllable; 
2) Solutions to (Zl) satisfy the following observability estimate: 


lzig» <C max |B! z(t)|pm, Vz €R”; (1.28) 
tc[0,T] 


3) Solutions to (CZI) enjoy the following observability: 
B'2(-) =0 in (0, T) > z = 0; (1.29) 


4) The rank condition (CA) holds; 
5) Gr defined by (LA) is non-degenerate, i.e., det Gr # 0. 


Moreover, under any one of the above conditions, for any yo, yi € R”, the 
control u(-) given by (LA) transfers the state of (LL) from yo to yı at time T. 


Proof: “1)<=>2)”. Clearly, it suffices to consider the special case that the 
initial datum zo in the system (LI) is equal to 0. We define an operator 
G : L1 (0, T; R™®) — R” by 


G(u()) 2 (T), Vu() € L'(0, T; R"), (1.30) 
where y(-) is the corresponding solution to (LI) with yo = 0. Then, by (I) 
(with yo = 0) and (LZA), we obtain that 


T 
(Y(T), zi pn -f (Bu(t),z(t))g.dt, Vz ER”. (1.31) 


where z(-) solves (ZJ). By (IL30)- (IL31]), it is clear that, 
(G'z)(t)—- B'z(t), a.e. t€ [0,T]. (1.32) 


Now, the exact controllability of (LT) is equivalent to that R(G) = R”; while 
the latter, by (L32) and in view of Theorem LIQ and the first assertion in 
Theorem [L7, is equivalent to the estimate ([LZR). 


“2)<= 3)”. By (£29), one can define a norm ||- ||; in R” as follows: 
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llzill; = max [B z(t)|p», 
tc[0,1] 


where z solves ([LZ7). By the equivalence of all norms in IR", we obtain that 
42)«—3)". “2)= 3)” is obvious. 


44)«—53)". Let us assume that B'z(-.) = 0 in (0, T) for some z, € R”. 
Then, by 
" 
z(t) 2 e^ (T792,, (1.33) 


this is equivalent to that 
B'(A*)'z, =0, keENU {0}. 


Therefore, by the Hamilton-Cayley Theory (in Matrix Theory), the above is 
equivalent to that 


z} B, AB, A^ B, «s An B| =0. (1.34) 
By (C34), it follows that 4)<= 3). 


“5)<=>3)”. Using again the expression (L33) for solutions to (CZA), we 
obtain that 5)«—53). 


Finally, by (LA), the corresponding solution y(-) to (IL) with u(-) given 
by (LA) satisfies 


T 
y(T) = e^T yo + n e^(7-9 Bu(t)dt 
0 


T 
s -f e4(T-0 BBT e^ (T-Üqgg 1 (eAT yo =i) 
0 


= e^T yy — GrG7 (e^T yo — y1) = yi 
This completes the proof of Theorem LIJ. Oo 


Let us analyze a little more the dual equation (LZA). Write 


ns ez =t); 


wo = 41; 


(1.35) 


i.e., we simply reverse the time in (LZA). Then, (£27) is reduced to the fol- 
lowing: 


Wt = Aly, tc (0, 17, 
(1.36) 


w(0) = wo. 


By Theorem LIJ, it is easy to see that the system (LI) is exactly controllable 
if and only if solutions to (L30) enjoy the following observability: 


B'w(-) 2 0 in (0, T) > wo = 0. 
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Things will be much more complicated to handle the controllability prob- 
lems for stochastic equations, even in finite dimensions. Indeed, in the stochas- 
tic setting, as we will explain in Chapter Hl, one cannot use a similar trans- 
formation as that in (L38) to reduce the dual equation (LZA) to a forward 
one, and therefore, in order to solve the stochastic controllability problem un- 
der consideration, generally speaking we will have to handle the observability 
for the corresponding (genuinely) backward stochastic equation. On the other 
hand, since one may put controls on both drift and diffusion terms in the 
stochastic setting (as we shall see in Chapter Bl, sometimes it is also necessary 
to introduce controls in such a way), even the choice of control class (and 
therefore the definition of controllability) is a delicate problem. Indeed, in or- 
der that the drift term makes sense, one needs the control to be L1-integrable 
in time; while for the diffusion one, people need the control to be L?-integrable 
in time. The problem is then how to balance the time integrability of controls 
and minimize the number of controls. As far as we know, such a problem is 
actually unclear even for controllability of stochastic differential equations in 
finite dimensions (See some progress in this respect in Chapter Ø). 

We now use the duality argument to analyze a quadratic optimal control 
problem for the linear system (IL) (with a given yo € R”), for which the cost 
functional is given by 


T 
1 
IUO) = 5 f (MO ass + (Rul) (Dus) t SCC (TD) 
(1.37) 
where M = MT € R^*^, R = RT e R"*", G = GT € R™ ul.) € 
L?(0,T;R"). Similarly to that for (ILIU), u(-) € L?(0,T; R") is called an 
optimal control for the control system (LI) with the cost functional (IL2)), 


if 
J(u(-)) = J (u(-)). 


inf 
u(-)€ L2 (0,T;R") 
The corresponding solution 7(-) 2 y(-) to (LI) (with u(-) replaced by u(-)) is 
called an optimal trajectory, and (u(-), g(-)) is called an optimal pair. 

In order to give a necessary condition for which au(-) and g(-) satisfy, by 
the classical variational method, we take any € € R and u(-) € L?(0, T; IR"), 
and set 

u*(-) = u(-) + eu(-). (1.38) 
Denote by y*(-) the corresponding solutio to (LI) (with u(-) replaced by u*(-)). 
Then 

y C) = 90) +er(), 


where r(-) satisfies the following variational equation: 


rit) = Ar(t)+ Bu(t), t€ [0,7], (1.39) 


r(0) — 0. 
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Clearly, 


Hence, 


T 
f (( MY), rE) pn + (Rul), ult) ra) dt + (GYT), r(T))g. =0. (1.40) 


Obviously, (L40) is a necessary condition for the optimal pair (y(-), u(-)). 
In order to re-write (L40) in a better form, similarly to (CZJ), people intro- 
duce a “backward” ordinary differential equation as follows: 


CNW i = 
m — —A v(t) + My(t), (1.41) 
Y(T) = -Gy(1). 
Computing Z (r(t), v(t) )gn, from (C39) and (ILI), we obtain that 
T 
[, (CANDO + C379) (029) dt = ACIDE) a (i 


Vu(-) e L?(0, T; R”). 


Finally, combining (L40) and (L2), we conclude the following necessary con- 
dition for (g(-), u(-)): 
Ra(t) = B' y(t). (1.43) 


Using a similar method, one can prove the maximum condition (L0) 
except that the details are more complicated than that to prove (L43), and 
more importantly, since the control set U is any given subset of R™ (without 
assuming any linearity or convexity conditions on U), the classical variation 
(L39) has to be replaced by the following spike variation: 


" [o t € (0, T] V Ee, T 


u(t), t € Ez, 


where u(-) € Uaa, € € (0, T], E:(C [0, T]) is a measurable set with the Lebesgue 
measure m(E;) = e. 

Nevertheless, there are some essential difficulties to extend the results for 
optimal controls in deterministic problems to the stochastic situation. Firstly, 
similarly to the dual equation (LZA) for the controllability problem, in the 
study of stochastic optimal control problems, as a counterpart of the dual 
equation ([LIZ) (also (ILAT)), people need to introduce backward stochastic 
differential equations ([BI]). Secondly, again similarly to the controllability 
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problems, since one may put controls on both drift and diffusion terms in the 
stochastic setting, the corresponding necessary conditions for optimal controls 
(even in finite dimensions) are quite different from the deterministic problems, 
for example the first order necessary condition when the diffusion term may 
contain the control variable and the set of controls is allowed to be nonconvex 
((273]) and the second order necessary condition when the diffusion term con- 
tains the control variable even if the set of controls is convex ([B78, B79, B80] ). 
Thirdly and more challengingly, since we are mainly concerned with opti- 
mal controls for stochastic evolution equations in infinite dimensions, we have 
to handle operator-valued backward stochastic evolution equations, for which 
there exists no any satisfactory theory (in the previous literatures) on stochas- 
tic integration/evolution equations that can be employed to derive the well- 
posedness of such equations in the usual sense. In order to overcome this 
difficulty, we introduce a new concept of solution, i.e., transposition solutions 
to the desired operator valued backward stochastic evolution equation, and 
prove the corresponding well-posedness (See [242, Z48| and Chapters [I2 and 
for details). Note that, as we shall explain in the next section, our stochastic 
transposition method can also be viewed as a variant of the duality argument. 


1.4 Two Basic Methods in This Book 


In this section, we shall present two basic methods (via illuminating examples) 
that will be systematically used throughout this book. 

'The main method that we employ in this book to deal with the analysis of 
the structure of stochastic distributed parameter systems is the global Carle- 
man type estimate. This method was introduced by T. Carleman (|#7]) in 1939 
to prove the uniqueness of solutions to second order elliptic partial differential 
equations with two variables. The key in |I] is an elementary energy estimate 
with some exponential weight. This type of weighted energy estimates, now 
referred to as Carleman estimates, have become one of the major tools in the 
study of unique continuation property, inverse problems and control problem- 
s for many partial differential equations. However, it is only in the last ten 
plus years that the power of the global Carleman estimate in the context of 
controllability of stochastic partial differential equations came to be realized. 
For the readers! convenience, we explain the main idea of Carleman estimate 
by the following very simple example: 


Example 1.14. Consider the following ordinary differential equation in IR": 


y(0) = yo. 


(1.45) 


It is well-known that if a € L?*(0, T), then there is a constant Cr > 0 such 
that for all solutions of (C44), it holds that 
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max |y(t)|[R» X Cr|yoles, ^— Vyo € R^. (1.46) 
te [0,T] 


Now we give a slightly different proof of this result via Carleman-type esti- 
mate: 
For any A € R, it is easy to see that 


d 
PARATOS 


= —23e ?" y(0i.. + 2e ?" y(t), Y(t) pn = 2(a(t) — A)? lutk. 
(1.47) 
Choosing A = [a|r»(o,r), we find that 
ly(t)In» <e** |yolen, t € [0,7], 
which proves (L40). 


It is easy to see that, the equality (LZ) can be re-written as the following 
pointwise identity: 


E d, = 
2e 7" y(t), Y(t) en = (6 7 yin) + 22677" y(t) len (1.48) 
Note that 4 is the principal operator of the first equation in (L43). The 


main idea of ([LZW) is to establish a pointwise identity (and/or estimate) 
on the principal operator M in terms of the sum of a “divergence” term 
42 (e?*|y(t)|2.) and an “energy” term 2Ae-?*[y(t)|2... One then chooses A 
being large enough to absorb the undesired terms. 

In the above example, the weight function depends only on the time vari- 
able t. By suitably choosing time and spatial dependent weight functions, one 
can apply the method of Carleman-type estimates to handle many problems in 
both deterministic and stochastic partial differential equations. Nevertheless, 
usually for many control problems for stochastic partial differential equations, 
people have to establish Carleman-type estimates for backward stochastic par- 
tial differential equations (in which one has two unknowns in one equation), 
and therefore the results that can be obtained so far are not so satisfactory. It 
seems that people need to introduce some Carleman-type estimates with the 
weight functions being suitable stochastic process (i.e., which should depend 
on the sample point as well) but this remains to be done. 


'The main method that we employ in this book to deal with optimal con- 
trol problems for stochastic distributed parameter systems is the stochastic 
transposition method (See Chapters [IZ and [I3 for details). More precisely, we 
solve the corresponding dual equations, including operator-valued backward 
stochastic evolution equations in particular, which are key tools to establish 
the Pontryagin type maximum principle, in the sense of transposition solu- 
tion. In the stochastic setting in finite dimensions, based on a new and delicate 


1.4 Two Basic Methods in This Book 21 


Riesz-type Representation Theorem (to characterize the dual of the Banach 
space of some vector-valued stochastic processes having different integrability 
with respect to the time variable and the probability measure) (See [239] and 
'Theorem in Chapter Ø), the stochastic transposition method (for solving 
backward stochastic differential equations) was first introduced in our paper 
[241] (See BO, pp. 353-354] for a rudiment of this method). Our method was 
further developed in [242] (and also (244), 245]) for the stochastic setting in 
infinite dimensions (See also Chapters Hl and A). Recently, in [248] we employ 
the stochastic transposition method to characterize the optimal feedbacks for 
general stochastic linear quadratic control problems (with random coefficients) 
in infinite dimensions, in which the point is to introduce a suitable notion of 
solutions (i.e., transposition solutions) to the corresponding operator-valued 
backward stochastic Riccati equations (See also Chapter [L3). 

Although our stochastic transposition method was developed to handle 
backward stochastic evolution equations, it is stimulated by the classical trans- 
position method to solve the non-homogeneous boundary value problems for 
deterministic partial differential equations (See [208] for a systematic intro- 
duction to this topic). For the readers' convenience, as in [244], let us recall 
the main idea of the classical transposition method to solve the following wave 
equation with non-homogeneous Dirichelt boundary conditions: 


yu — Ay =0 in Q, 
y=u on X, (1.49) 
y(0)— yo. w(0)-—wi in G. 
Here G C R" is a nonempty open bounded domain with a C? boundary 
T, Q = (0,T) x G, X = (06,7) x DP, (yogy1) € D2(G) x H^!(G) and u € 
L?((0, T) x I) are given, and y is the unknown. 
When u = 0, one can use the standard semigroup theory to prove the 
well-posedness of (LÆ) in the space C([0, T]; L?(G)) Q C ([0, T]; H ^! (G)). 
When u Æ 0, y|z = u does NOT make sense any more by the usual 
trace theorem in theory of Sobolv spaces. One needs to use the transposition 
method. To this end, for any f € L!(0,T; L?(G)) and g € L'(0,T; H}(G)), 
let us consider the following test equation: 
Ce — AG— ftgs  inQ, 
¢=0, on X, (1.50) 
((T)=G(T)=0, inā. 
(C50) admits a unique solution ¢ € C([0, T]; H1 (G)) (1C! (0, T]; L?(G)), 
which enjoys a hidden regularity 9s € L?(X) (e.g. [207]). Here and hence- 
forth, v(x) = (v! (x), --- ,v^(x)) stands for the unit outward normal vector of 
Gatzcl. 


To give a reasonable definition for solutions to (L49), we first consider 
the case that y is smooth. Assume that f € L?(Q), g € C (0, T; Hi(G)), 
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yı € L?(G), and that y € H?(Q). Then, multiplying the first equation in 
(C49) by C, integrating it in Q, and using integration by parts, we find that 


= = T= am 
[fuc moneat = f (ccs &(0)yo)d Ls dX. (1.51) 


Clearly, (LAI) still makes sense even if the regularity of y is relaxed as y € 
C([0, T]; L2 (G)) N C1 (0, T]; H ^! (G)). This motivates the following notion: 


Definition 1.15. We call y € C([0, T]; L?(G)) N C! (10, T]; H^! (G)) a trans- 
position solution to (29), if y(0) = yo, w(0) = yı, and for any f € 
L'(0, T; L?(G)) and g € L! (0, T; Hà(G)), it holds that 
T 
fia- f (9, Yt) m a), (adt 


ð 
= (0). Jagen are, ~ | GOude- | Fads, 


where C is the unique solution to (L50). 


One can show the well-posedness of (L49) in the sense of Definition 
LIA, by means of the classical transposition method ([208]). The point of 
this method is to interpret the solution to the forward wave equation (L49) 
(with non-homogeneous Dirichlet boundary conditions) by means of the test 
equation ([L5U), which is a backward wave equation with non-homogeneous 
source terms. In the deterministic setting, since the wave equation is time- 
reversible, there exists no essential difference between the forward equation 
and the backward one. Nevertheless, this reminds us to interpret backward 
stochastic differential/evolution equations in terms of forward stochastic dif- 
ferential/evolution equations, as we have done in [241], 242] and so on. 

Clearly, the transposition method is a variant of the classical duality ar- 
gument, and in some sense it provides a way to see something which is not 
easy to be detected directly. Indeed, it is easy to see that, the main idea 
of this method is to interpret the solution to a less understood equation by 
means of another well understood one. Nevertheless, the philosophy of our 
stochastic transposition method is quite different. Indeed, the main purpose 
to introduce stochastic transposition method in our works is not to solve the 
non-homogeneous boundary value problems for stochastic partial differential 
equations (though it does work for this sort of problems, see Proposition 
of Chapter B in this book, for example) but to solve the backward stochastic 
equations (especially the operator-valued backward stochastic evolution equa- 
tions mentioned above), in which there exist no boundary conditions explicitly 
(or even no boundary conditions at all)! 


1.5 Notes and Comments 


Sections [LT and [L2 are partially based on [889] and [220], respectively. 
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Theorem [L1 can be found in [202, Lemma 2.4 in Chapter 7]), for example. 
Theorem L can be found in PJI, Lemma 4.13, pp. 94-95 and Theorem 4.15, 
p. 97] and B30, Theorem 1.2 and Remark 1.3]). Theorem is well-known 
(e.g., BZ, Theorem 2.1 in Chapter 2 of Part IV, p. 207]). 

It seems that Example LTA was firstly introduced in [ZOI] to explain the 
main idea of Carleman estimates (See [ISN| and also [LIU] for much more 
general pointwise weighted identities/inequalities). The material in Section 
L4 is partially based on [201, 244]. 
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Some Preliminaries in Stochastic Calculus 


This chapter is a concise introduction to stochastic calculus (in infinite di- 
mensions in particular), which will play a fundamental role throughout this 
book. Especially, we collect the most relevant preliminaries for studying con- 
trol problems in stochastic distributed parameter systems. Also, we will pro- 
vide some unified notations (which may differ from one paper/book to anoth- 
er) to be used in later chapters. 

'To present the proofs for all the results introduced in this chapter would 
considerably increase both the size and scope of this book. Thus, we dis- 
tinguish two different cases. When we think that the proof is important in 
understanding the subsequent materials and/or when there is no immediate 
reference available, we will provide the details. Otherwise, we omit the proofs 
but giving standard and easily accessible references. Knowledgeable readers 
may skip this chapter or regard it as a quick reference. 


2.1 Measures and Probability, Measurable Functions and 
Random Variables 


Fix a nonempty set f2 and a family F of subsets of (2. For any E € F, denote 
by xzg(-) the characteristic function of E, defined on 2. F is called a o-field 
on £2 ifi) Q € F; ii) Q\ A € F for any A € F; and iii) L^, A; € F whenever 
each A; € F. 

If F is a o-field on £2, then (Q, F) is called a measurable space. An element 
A € F is called a measurable set on (62, F), or simply a measurable set. A 
set function u : F — [0, +00] is called a measure on (Q, F) if (0) = 0 and 
u is countably additive, i.e., (UU, Ai) = O72, u(Ai) whenever {A;}%, are 
a sequence of mutually disjoint sets from F. The triple (2, F, p) is called a 
measure space. The measure p is called finite (resp. o-finite) if u((2) < oo 
(resp. there exists a sequence (4;);24 C F so that 2 = UZ] A; and u(A;) < 
oo for each i € N). We call A a p-null (measurable) set if (A) = 0. 
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A probability space is a finite measure space (2, F, P) for which P(Q2) = 1. 
In this case, P is also called a probability measure; any w € 2 is called a sample 
point; any A € F is called an event, and P(A) represents the probability of the 
event A. If an event A € F is such that P(A) = 1, then we may alternatively 
say that A holds, P-a.s., or simply A holds a.s. (if the probability IP is clear 
from the context). 

For any measure space (Q, F, u), write N = (B C Q | B C A for some 
p-null set A}. (Q, F, u) is said to be complete if M C F. Especially, one may 
define complete probability space (£2, F, P). If (2, F, u) is incomplete, then 
the class F of all sets of the form (EN N) U (N V E), with E € F and NEN, 
is a o-field which contains F as a proper sub-class, and the set function ji 
defined by p((E V N) U (N V E)) = u(E) is a complete measure on F . The 
measure ji is called the completion of p. 

Let (£21, 1), --- , (24, Fn) be measurable spaces, n € N. Denote by Fy x 
-« X Fn the o-field™ (on the Cartesian product Q, x «++ x (2,) generated by 
the subsets of the form A, x --- x An, where A; € Fj, 1X i n. 

Let p; be a measure on (£2;, Fi). We call u a product measure on (2; x 
eX Rn, Fı X +++ x Fn) induced by p4,--+ , Hn if 





(Ai x +++ x An) =] ui(As), vAe-. 
i=1 


Theorem 2.1. Let (Qi, Fi, pi) be a o-finite measure space, 1 < i < n. Then 
there is one and only one product measure u (denoted by uy x +++ x un) on 
(Q4 x x Rn, Fy X ox Fn) induced by {u;i}. 


Further, we consider the product spaces and product measures for count- 
ably many measurable spaces and measures. In this case, for simplicity, we 
only present the definition and related result for probability spaces, which is 
enough for the rest of this book. Let ((£2;,.7;));24 be a sequence of measur- 
able spaces. Denote by [[7-, F; the o-field on the Cartesian product [T75, 2; 
generated by the subsets of the form 


IH A;, where A; € F; for all i € N, and A; = Q; for all 


but a finite number of values of i. (2.1) 


Let P; be a probability measure on (£2; Fi), i € N. We call P a product 
probability measure on ([I754 2: TI;4 Fi) if for any [I7-, A; of the form 


2. Man 
"(II^) = [] P40. 


1 Note that here and henceforth the o-field Fı x --- x Fn does not stand for the 
Cartesian product of Fi, ---, Fn. 
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Theorem 2.2. Let {(2;, Fi, P;));24 be a sequence of probability spaces. Then, 
there is a unique product probability measure P (denoted by []?-, Pi) on 
M 2%, I2 Fi) induced by (P;)29,. 


If (G, 7) is a topological space (on a given nonempty set G), then the 
smallest o-field containing all open sets of G is called the Borel o-field of G, 
denoted by B(G). Any set A € B(G) is called a Borel set (in (G, J)). Let H 
be a metric space with metric d. We call any A € B(H) a Borel set in H. 

Let (2, F) and (2’,¥’) be two measurable spaces and f : R —> f?! bea 
map. The map f is said to be F/F’-measurable or simply F-measurable or 
even measurable (in the case that no confusion would occur) if f^ 1(7") C F. 
Particularly if (2’,F’) = (H,B(H)), then f is said to be an (H-valued) F- 
measurable (or simply measurable) function. In the context of probability 
theory, f is called an (H-valued) F-random variable or simply a random 
variable (if the meaning is clear from the context). Note that measurable map 
or random variable is defined without measures. Also, it is clear that random 
variable is a special case of measurable map. 

For a measurable map f : (2,7) > (Q2',.F"), it is easy to show that 
f-\(F') is a sub-o-field of F. We call it the o-field generated by f, and 
denote it by o(f). Further, for a given index set A and a family of measurable 
maps {fx},ea (defined on (2, F), with possibly different ranges), we denote 
by a(fy;A € A) the o-field generated by Uyeao(fy). 

Now, let us introduce an important notation, independence, which distin- 
guishes probability theory from the usual measure theory. 


Definition 2.3. Let (2, F,P) be a probability space. 

1) We say that two events A and B are independent if P(A B) — 
P(A)P(B); 

2) Let J, and Jz be two subsets of F. We say that J, and Jz are inde- 
pendent if P(AN B) = P(A)P(B) for any A € J, and B € Jo; 

3) Let f and g be two random variables defined on (2, F) (with possibly 
different ranges), and J C F. We say that f and g are independent if o(f) 
and c(g) are independent. We say that f and J are independent if o(f) and 
J are independent; 

4) Let (Ax]aeA C F. We say that (Ax]xeA is a class of mutually in- 
dependent events if P(A), N --- O Ayp) = P(A),)---P(Ay,) for any k € N, 
Mist AR € A satisying M A A; whenever i £ j, i,j — 1, ,k. 


The following result is known as the Borel-Cantelli lemma. 


Theorem 2.4. 1) Suppose that {Aj}72, is a sequence of measurable sets in 
a measure space (Q, F, u). If Yc u(Ai) < +00, then u(lim A;) = 0. Here 
1—00 


and henceforth, 


lim 4; 2 2 Ù Ai. 
TES k=1i=k 


28 2 Some Preliminaries in Stochastic Calculus 


2) If (Q,F,P) is a probability space and (A;);24 is a sequence of mutu- 
ally independent events, then the condition 37,-, P(A;) = +00 implies that 
P( lim A;) — 1. 

1— 00 


Remark 2.5. In the probability context, the first conclusion in Theorem 2.4 
states a condition that (almost surely) an event occurs only finitely often; and 
the second one in this theorem states that, in the independence case, if the 
condition is not satisfied, the event is almost sure to occur infinitely times. 


Let f be a map from Q to 2’ and $ be a property concerning the map 
f at some elements in 92. In the rest of this book, we shall simply denote by 
($8) the subset {w € 2 | P holds for f(w)}. For example, when Q’ = R we 
use {f > 0) to denote {w € R | f(w) > 0). 

The following two notions of convergence are used frequently. 


Definition 2.6. Let ((2,.F, u) be a measure space and {fi}So be a sequence 
of H -valued functions defined on 22. 

1) The sequence {fk} is said to converge to fo in measure, denoted by 
fo = u- jim, fre, if d( fk, fo) is F-measurable and for every £ > 0, 


Jim. w({d(fe, fo) 2 £3) = 0. 


(In the context of probability theory, (fuge, is said to converge to fo in 
probability). 

2) The sequence {fk}; is said to converge to fo almost everywhere, de- 
noted by limy. o5 fk = fo, u-a.e., if {imko fk # fo} € F, and 


(t lim fy # fot) = 0. 
—oo 
(Clearly, in the context of probability theory, {fk}; converges to fo a.s.). 


The relationship between convergence in measure and convergence almost 
everywhere is as follows. 


Theorem 2.7. Suppose that (N), F, 11) is a measure space and (fi);29 is a 
sequence of H -valued functions defined on 22. 

1) If {fe}? converges to fo in measure, then there is a subsequence 
Uf ea of {fk} such that fr, > fo, n-a.e. as k — co. 

2) Suppose in addition that u is finite, and d( fk, fo) is F-measurable for 
each k € N. Then the u-a.e. convergence of ( fx}?2, to fo implies that ( fk M4 
converges to fo in measure. 


Clearly, the H-valued measurable functions/random variables introduced 
in the above are natural generalization of the usual real valued measurable 
functions/random variables. However, as pointed in [264], when H is a non- 
separable Banach space, the sum of two H-valued measurable functions is 
not necessary to be measurable. Because of this, one needs to introduce oth- 
er notions for measurable functions (or random variables in the context of 
probability) valued in metric spaces. 
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Definition 2.8. Let f(-) be an H-valued function defined on a measurable 
space (Q, F). 

1) The function f(-) is called weakly F-measurable (or simply, weakly mea- 
surable) if H is a Banach space, and for any y € H*, the (scalar) function 
p(f(-)) is measurable; 

2) We call f(-) an F-simple function if 8 


k 


fo = p» XE; )hi, (2.2) 


i=l 


for some k € N, h; € H, and mutually disjoint sets E1,--- , Ey € F satisfying 
Les E; = 2; 

3) We call f(-) an F-countably valued function if f(-) = 21 xg C)hi, 
for some hi, ho,--- € H, and mutually disjoint sets E1, E5,--- € F satisfying 
Uic. Ei = 2; 

4) The function f(-) is said to be strongly F-measurable or simply strong- 
ly measurable if there exists a sequence of (H-valued) F-simple functions 
{fr}? converging pointwise to f; 

5) The function f(-) is said to be separably valued if its range (f(w) | wv € 
NY} is separable. 


The following result indicates that when H is separable, the above de- 
fined strong F-measurability, F-measurability and weak F-measurability are 
equivalent. 


Theorem 2.9. Let f(-) be an H-valued function defined on a measurable s- 
pace (2,F). Then, the following two statements are equivalent: 

1) f(-) is strongly F-measurable; 

2) f(-) is F-measurable and separably valued. 
Further, if H is a Banach space, then the above two statements are equivalent 
to: 

3) f(-) is weakly F-measurable and separably valued. 


For vector-valued functions defined on measure spaces, one may slightly 
change/weaken the requirement in Definition ZA 4)—5) as follows. 


Definition 2.10. Let f(-) be an H-valued function defined on a a-finite mea- 
sure space (Q, F, p). 

1) The function f(-) is said to be strongly F-measurable or simply strongly 
measurable (w.r.t. u) if there exists a sequence of (H -valued) F-simple func- 
tions (fe) g., such that Jum fk = f, u-ae.; 


2) The function f(-) is called -almost separably valued if there exists a 
Eo € F such that u(Eg) = 0 and {f (w) | w € (2X Eo} is separable. 


2 When H is a Banach space, we denote by H* the dual space of H. 
3 Since E1,--- , Ey are mutually disjoint, the function f(-) in (Z2) is simply defined 
by f(x) = hi when a € E; for some i = 1,--- ,k. 
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Note that, for any measurable space (2, F), one may define a trivial mea- 
sure uo by uo(ģ) = 0 and uo(A) = oo for any nonempty A € F. Hence, the 
strongly F-measurable functions and separably valued functions in Definition 
are special cases of that in Definition ZIU. Clearly, the norm of (H-valued) 
strongly F-measurable function (w.r.t. 4) is measurable, and any linear com- 
bination of two strongly F-measurable functions (w.r.t. p) is strongly measur- 
able whenever H is a Banach space; the (j-almost everywhere) strong limit 
of a sequence of strongly F-measurable functions is strongly measurable. 

Similar to Theorem ZJ, one has the following result. 


Theorem 2.11. Let f(-) be an H-valued function defined on a complete a- 
finite measure space (2, .F, u). Then, the following two statements are equiv- 
alent: 

1) f(-) is strongly F-measurable w.r.t. p; 

2) f(-) is F-measurable and -almost separably valued. 
Further, if H is a Banach space, then the above two statements are equivalent 
to: 

3) f(-) is weakly F-measurable and -almost separably valued. 


By Theorem ZM, it is clear that when (N, F, u) is a complete o-finite 
measure space and H is a separable Banach space, the strong J--measurability 
w.r.t. u, the F-measurability and the weak F-measurability are equivalent. 
Also, we remark that, the completeness assumption on (12, F, p) in the second 
part of Theorem ZL] cannot be dropped (Indeed, without this assumption, 
the strong F-measurability w.r.t. u does not imply the weak F-measurability, 
even in finite dimensions). 

Also, one has the following characterization on the strong F-measurability 
W.r.t. Lb. 


Proposition 2.12. Let (Q,F,) be a c-finite measure space. Then, f(-) is 
an H-valued, strongly F-measurable (w.r.t. u) function on (2,F, u) if and 
only if there exist a -null set Qo and a sequence of F-countably (H-)valued 
functions {fi(-)}S2, such that {fi(-)} converges to f(-) uniformly in Q\ Qo. 


We shall use the following result, known as the Doob-Dynkin lemma. 


Theorem 2.13. Let (2,F) be a measurable space, Hı and Ho be two sepa- 
rable Banach spaces, and fy : Q —> Hy (k = 1,2) be F-measurable functions. 
Then f2 = g(fi) for some B(H,)-measurable function g : Hı — Hə if and 
only if o(f2) C o(fi). 


Proof: We need only to prove the "if" part. Put 
us nC C) | n: Hı > Ha is B(Hi)-measurable] . 
It suffices to show that 


H contains all H5-valued, o(f1)-measurable functions. (2.3) 
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Now we prove (ZA). Clearly, H is a linear space. Let 
FE{ACQ| xa )he H, vhe Hj). 


If A € o(fi), then A = f, '! (B) for some B € B(Hi), which leads to y4(-)h = 
xaB(fiC))h € H for any h € H5. Hence, o(f;) C F'. For any Hs-valued, 
o(f1)-measurable function C, we select a sequence of H»-valued, o(f1)-simple 
functions {¢,}?2., such that limy. o5 ¢x(w) = C(w) for any w € 2. Without 
loss of generality, we assume that Qi (-) = ye Xfr tga Ohi for some 4p € N, 
lk — oo as k — oo, hi € Hə, Bi € B(Hi) and B; N Bj = § when i Æ j 
(j =1,--- ,£&). Write 


£k oo 
mCO-*x&0, | B-l[JB. 
i=1 i=1 


It is easy to see that 7,(f1(-)) = ¢x(-). Define 


lim n(x), «EB, 
k—oo 


n(x) = 
0, z € Hy \B. 


Clearly, n : Hı — Hə is B(Hi)-measurable and ¢(-) = 7(fi(-)). Thus, 
¢(-) € H. This completes the proof of (Z3). o 


2.2 Integrals and Expectation 


In this section, we recall the definitions and some basic results for the Bochner 
integral and the Pettis integral. We omit the proofs and refer the readers to 
(74, 3]. Let us fix a o-finite measure space (Q, F, 11), a probability space 
(£2, .F, P) and a Banach space H. 

Let f(-) be an (H-valued) F-simple function in the form (Z2). We call 
f(-) Bochner integrable if u(E;) < oo for each i = 1,--- , k. In this case, for 
any E € F, the Bochner integral of f(-) over E is defined by 


k 
] ftn - Y MEn Eh 


In general, we have the following notion. 


Definition 2.14. A strongly F-measurable function f(-) : R — H is said to 
be Bochner integrable (w.r.t. u) if there exists a sequence of Bochner integrable 
F-simple functions (f;(-));94 converging strongly to f(-), u-a.e. in R, so that 


im f fils) — fj G)lrdu = 0. 


i, j— oo 
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For any E € F, the Bochner integral of f(-) over E is defined by 


f fe)du= fim f xau) im B. (2.4) 
E 1—00 Q 


It is easy to verify that the limit in the right hand side of (ZÆ) exists 
and its value is independent of the choice of the sequence {f;(-)}92,. Clearly, 
when H = R” (for some n € N), the above Bochner integral coincides the 
usual integral for IR"-valued functions. 

Particularly, if (2, .F, P) ia a probability space and f : R — H is Bochner 
integrable (w.r.t. P), then we say that f has a mean, denoted by 

















Ef = f fdP. (2.5) 











We also call Ef the (mathematical) expectation of f. 
'The following result reveals the relationship between the Bochner integral 
(for vector-valued functions) and the usual integral (for scalar functions). 





Theorem 2.15. Let f(-) : Q — H be a strongly F-measurable w.r.t. p. 
Then, f(-) is Bochner integrable w.r.t. u if and only if the scalar function 
fg: 0 — R is integrable w.r.t. u. 


Further properties for Bochner integral are collected as follows. 


Theorem 2.16. Let f(-), g(-): (2,F,u) > H be Bochner integrable. Then, 
1) For any a,b € C, the function af(-) + bg(-) is Bochner integrable, and 


T (af (s) + bg(s))du = af fau b | o(s)dn, VE EF. 


2) For any E € Ff, 


|f ren], = f |f (s)| dp. 


3) The Bochner integral is u-absolutely continuous, that is, 


li du = 0 in H. 
repli, [fan =O in 


4) IfF € L(A; H), then F f (-) is an H -valued Bochner integrable function, 
and for any EEF, 


Í Ff(s)du = F I. f(s)dp. 


It is easy to show the following result. 
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Proposition 2.17. Let H be a Hilbert space. If f and g are independent, 
Bochner integrable random variables on ((2,.F, P), valued in H, then (f,g)u 
is integrable, and 


























E(f, g)u = (Ef, Eg)g. (2.6) 


'The following result, known as Dominated Convergence Theorem, will be 
used frequently in the sequel. 








Theorem 2.18. Let f : (2,F,~) — H be strongly measurable, and let g : 
(£2, .F, u) — R be a real valued nonnegative integrable function. Assume that, 
fi: (Q,F,u) > H is Bochner integrable so that |f;|g < g, u-a.e. for each 
i € N and limj.o f; = f, n-a.e. Then, f is Bochner integrable, and 


lim | fi(s)du = | f(s)du, VEEF. 
1—00 E E 


The following result, known as Monotone Convergence Theorem (also 
called Levi’s lemma), will be used in the sequel. 


Theorem 2.19. Let f : (2 — H be strongly measurable. Assume that, fi : 
Q — H is Bochner integrable w.r.t. 4 so that |fila <|fizila, n-a.e. for each 
i € N, supjen fo Miludu < oo and limj +0 f; = f, p-a.e. Then the same 
conclusion as that in Theorem ZTA holds. 


'The following result, known as Fatou's lemma, will be useful in the sequel. 


Theorem 2.20. Let f, fi: (2,F,u) — IR be real valued integrable functions 
(i €N). Assume that f € fi, u-a.e. for each i € N. Then, 


[tm fede < lim Me VEEF. 
Ei—oo i—0oo 
Also, one has the following Fubini Theorem (on Bochner integrals). 


Theorem 2.21. Let (04,1, p1) and (£25, F2, 2) be a-finite measure spaces. 
If n > DOO x (29 E is oe integrable, then the functions y(-) = 
Jos Jdui(t) and z(-) = = dad s)du»s(s) are a.e. defined and Bochner 
Tn on Nə and AY iEn Moreover, 


i f(ts)dui x u2 = L z(t)duı (t) = f, y(s)dpi2(s). 


For any p € (0,00), denote by L(0; H) 2 P(Q, F, p H) the set of all 
(equivalence classes of) strongly measurable functions f : (Q, F, u) > H 
such that fo |f|z;du < oo. When p € [1,0o), this is a Banach space with the 


norm 
1/p 
ieee ( n du) | (2.7) 
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(Particularly, when H is a Hilbert space, so is L3-(2;H)). We denote by 
LY (0; H) 2 pe(Q, F ‚u; H) the set of all (equivalence classes of) strongly 
measurable (H-valued) functions f such that esssup,,ca|f(w)|H# < oo. This 
is also a Banach space with the norm 


|f Ire (ou) = esssupueplf(w)|n- (2.8) 


For 1 € p € oo and T > 0, we shall simply denote L?((0, T), £,m; H) by 
L? (0, T'; H), where £ is the family of Lebesgue measurable sets in (0, T), and 
m is the Lebesgue measure on (0, T). Also, we simply denote L4-(2;R) and 
L?(0, T; R) by L-(2) and L"(0, T), respectively. 

The following easy result is known as Chebyshev's inequality. 


Theorem 2.22. For any p € [1,+00), f € L-(2; H) and à > 0, it holds that 


nlla =) & xs f Mide (29) 


'The following simple result is sometimes useful. 


Lemma 2.23. If p € (0,00) and f € L4.(Q; H), then 


-Foo 
f rin = f X u({fl > APA. (2.10) 
(2 0 


Proof: Since p € (0, +00), we have 


flu -Foo 
[intimo f an [amo tm xni 
Q Q 0 (2 0 
Coo 
=p | X7 (f| Ay)dA 
0 


which gives (210). O 


In the sequel, we will need the following concept of uniform integrability. 


Definition 2.24. Suppose K C L} (N; H). We call K a uniformly integrable 
subset (of L}Ł(Q; H)) if Fara |fladu converges to 0 uniformly (for any 
f EK) as s > +00. 


Obviously, if u(f2) < oo and K is a uniformly integrable subset of 
L5-(2; H), then it is also bounded in L-(f2; H). 

The following result characterizes the L-convergence in terms of the uni- 
form integrability. 


Theorem 2.25. Let Uie C LŁ(Q; H). Then f; > fo in LE(2; H) as 
i — oo if and only if {fi}, converges to fo in measure and {fi}%, is 
uniformly integrable. 
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For nonnegative measurable functions, one has the following simple char- 
acterization of L!-convergence: 


Theorem 2.26. Let ( f;}229 be a sequence of nonnegative integrable functions 
on (Q,F, p). Then f; — fo in L}(Q) as i — oo if and only if {f,}S2, con- 
verges to fo in measure and limi. oo Sfo fidu = js fodp. 

Let (£2, F') be another measurable space, and ®: (2,F) — (',F’) be 


a measurable map. Then ® induces a measure v on (2, F’) via 
(ANEDHA), VA e. (2.11) 


The following is a change-of-variable formula: 


Theorem 2.27. A function f(-) : 2’ 2 H is Bochner integrable w.r.t. v if 
and only if f(®(-)) (defined on (€2,.F)) is Bochner integrable w.r.t. u. Fur- 


thermore, 


Fla! dou!) = | fG)dnt). (2.12) 
(2! (2 


2.3 Signed/ Vector Measures, Conditional Expectation 


We fix a measurable space (2, F) and a Banach space H. 


2.3.1 Signed Measures 
Let us begin with the following notion. 


Definition 2.28. A function u: F — [—oo, +00] is called a signed measure 
on (Q, F) if 

1) (0) = 0; 

2) uU Aj) = 224 H(A;) for any sequence {A;} of mutually disjoint 
sets from .F; and 

3) u assumes at most one of the values --oo and —oo. 


Example 2.29. Let v be a measure on (£2, F) and f be a real valued integrable 
function defined on (£2, F, v). Then 


WA) - f fav VAEF, 


defines a signed measure in (2, F). More generally, the above p is still a signed 
measure if f is a measurable function on (Q, F), and one of f* and f^, the 
positive and negative parts of f, is integrable on (Q, F, v). 


If u is a signed measure on (2, F), we call a set E C (2 positive (resp. 
negative) (w.r.t. u) if for every F € F, ENF is measurable, and u(ENF) > 0 
(resp. u(E  F) < 0). 


36 2 Some Preliminaries in Stochastic Calculus 


Theorem 2.30. If u is a signed measure on (2, F), then there exist two dis- 
joint sets A and B, whose union is 2, such that A is positive and B is negative 
u.r.t. p. 


'The sets A and B in Theorem are said a Hahn decomposition of Q 
w.r.t. u. It is not difficult to construct examples to show that Hahn decom- 
position is not unique. However, if 


Q = A U Bı and Q = A U Bə 


are two Hahn decomposition of 2, then it is easy to show that, for every 
measurable set E, it holds 


p(EnAi)- u(EnAs,) and p(EN By) = p(En Bə). 
From this fact, we may define unambiguously two set functions u^ and u^ 
on (Q, F) as follows: 

p(B) =W(ENA), m(E)--MEnB, VEEF. 
We call + and u^ respectively the upper variation and the lower variation 
of u. The set function |u|, defined for every E € F by 

|u|(E) = u+ (E) + u~ (E) 

is called the total variation of u. Obviously 

(E) = u+ (E)- u (E)  |u(E)2|wE) VE F. 


Also, it is easy to show that the upper, lower, and the total variations of a 
signed measure u are measures. 


Definition 2.31. A signed measure u on (Q, F) is said to be finite if |u(E)| < 
+oo for any E € F; u is said to be o-finite if for any E € F, there exists 
a sequence {E;}%, C F such that |u(Ei)| < +00 for every i € N and E C 
Uii Ej. 

Let u be a o-finite signed measure on (£2, F). If f : (2, F) — H is Bochner 
integrable w.r.t. |u| = u™ + u7, then f is said to be Bochner integrable w.r.t. 
u. The Bochner integral of f in Q w.r.t. u is defined by 


ri fduê I fdu* — I fap. 


For any E € F, we define 
f im | xetan 
E Q 


'The properties of the Bochner integral w.r.t. the above signed measure 
u is similarly to the usual (Bochner) integral except that all conditions such 
as “null measure sets” or “almost everywhere" w.r.t. u should be changed to 
that w.r.t. |p|. 
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Definition 2.32. Let u and v be two signed measures on (2,.F). We say that 
u is absolutely continuous w.r.t. v, denoted by u « v, if u(E) = 0 for every 
E € F with |v|(E) = 0. 


We recall the following fundamental result (known as the Radon-Nikodym 
Theorem) concerning absolute continuity. 


Theorem 2.33. Let u and v be two a-finite signed measures on (92,F) and 
i « v. Then there is a real valued measurable function f on (2 such that 


n) - | fav, VEcJ. 


The function f is unique in the sense that if also u(E) = fe fidv for another 
real valued measurable function fı om (2 and for all E € F, then f = fi, 
|v|-a.e. 


The function f in Theorem is called the Radon-Nikodym derivative (of 
u W.r.t. v), and is denoted by 
du 
Jes 


By Theorem E33, it is easy to conclude the following result. 


Theorem 2.34. Let the assumptions in Theorem ZZA hold and g : (Q, F) > 
H be strongly F-measurable. Then g is Bochner integrable w.r.t. u if and only 
if git is Bochner integrable w.r.t. v. Furthermore, 


d 
f sn f otav, V Ec. 
E E dv 


2.3.2 Distribution, Density and Characteristic Functions 


Let P be a probability measure on (£2,.F), and X : Q — H be a strongly 
measurable random variable. Then, as a special case of (2-11), X induces a 
probability measure Px on (H, B(H)) via 

Px(A)SP(X-1(A)), VAe€B(H) (2.13) 
We call Px the distribution of X. If X is Bochner integrable w.r.t. IP, then by 
(ZH) and using (212) in Theorem ZZA, we see that 














Ex = f xd P x (x). 
H 


In the case of H = R™ (for some m € N), Px can be uniquely determined 
by the following function: 


F(z) S F(zi,--- ,z4,) SP(Xi < ri, 1&i € m], (2.14) 
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where x = (z1,:-- ,@m) and (X1,--- , Xm) = X. We call F(x) the distribution 
function of X. If IPx is absolutely continuous w.r.t. the Lebesgue measure in 
R™, then by the Radon-Nikodym theorem (i.e., Theorem [LL33), there exists 
a (nonnegative) function f € L!(IR") such that 


Px(A) = | f (z)dz, V A € B(R”). (2.15) 
A 
Particularly, 


F(z) zd ef cB N (2116) 


The function f(x) is called the density of X. As a special case, if f(x) is of 
the following form: 


f(x) = [(21)"" det £u exp E =O a | , «& ER”, (2.17) 


for some à € R”, Q € R™*™ with Q! = Q > 0, then we say that X has a 
normal distribution with parameter (A, Q), denoted by X ~ (A, Q). We call 
X a Gaussian random variable (valued in R™) if X has a normal distribution 
or X is constant. 


Remark 2.35. Gaussian random variable appears in many physical models. 
Indeed, under some mild conditions, the mean of many independent and 
identically-distributed random variables is close to a Gaussian random vari- 
able (We refer to [BX] for more details). 


For Gaussian random variables, one has the following result. 
Theorem 2.36. Let X = (X1,--- , Xm) be a Gaussian random variable val- 
ued in IR". Then X4,--- , Xm are independent if and only if the matriz Q (in 
(ZTA) is diagonal. 

In the rest of this subsection, we assume that H and G are two Hilbert 


spaces. For any x € H and y € G, the tensor product x & y (of x and y) isa 
bounded linear operator from H to G, defined by 


(2 @y)h=(h, x) yy, Vhe H. (2.18) 
Let Q € L(H; G). We call Q a trace-class operator from H to G if 


A r 
trQ = sup { 5 (CQh,; Gu Jal | {hu}nca and {gu }uca are respectively 
HEA 


orthonormal basis in H and G} « oo. 


Denote by £/4(H;G) (or simply £1(H) if H = G) the space of trace-class 
operators, which is a subset of the space of all compact operators (from H 
to G). It is well known that £4(H; G) equipped with the trace norm trQ is a 
Banach space, and the following result holds (e.g. [299, Chapter III] and [355, 
Chapter 6]): 
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Proposition 2.37. Let H be a separable Hilbert space. Then, a nonnegative 
operator Q € L(H) is of trace-class if and only if for an orthonormal basis 
{hi}%, on H, 


oo 


XO (One hi) 00: 


i=1 
Moreover, in this case trQ = XZ; (Qhi, hi) y- 


For any X,Y € L2(02; H), we define the covariance operator of X and Y 
by 








Cov (X, Y) $E[(X — EX) & (Y — EY)]. (2.19) 
It is easy to show that Cov (X, Y) € £1(H). Particularly, 


























Var X 2 Cov (X, X) (2.20) 


is called the variance operator of X. It is not difficult to show that for a normal 
distribution A/(A, Q) (defined above), A is the mean and Q is the variance 
operator. When H is finite dimensional, the covariance/variance operator is 
usually called the covariance/variance matrix. 

For any H-valued, strongly measurable random variable X and € € H, 
when eX C) is integrable w.r.t. IP (It is always the case provided that H 
is a real Hilbert space), write 














ex(£) = keen 2 emn qP (a). (2.21) 
H 


We call yx(-) the characteristic function of X. It can be regarded as the 
Fourier transform of the probability measure induced by X(-). 
The characteristic function is unique in the following sense. 


Theorem 2.38. Assume that X and Y are two H -valued, strongly measurable 
random variables. If ox (-) = ey (-), then Px = Py. 


We will need the following notion. 


Definition 2.39. An H-valued random variable X is said to be Gaussian, 
denoted by X ~ N'(A,Q) if for some A € H and nonnegative symmetric 
operator Q € £A(H), 


ex) =e {Ou FQ60uh, veem — Qa) 


If an H-valued random variable X ~ A/(A, Q), then it is easy to check that 
EX = à and Var X = Q. 
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2.3.3 Vector Measures 


The results of this subsection can be found in [z4]. In this subsection, we fix 
a finite measure v on (Q, F) 
We begin with the following definition. 


Definition 2.40. An H-valued function u: F — H is called a vector mea- 
sure (on (2, F)) if u(0) = 0, and u is countably additive, i.e., for any sequence 
{Ak}; of mutually disjoint sets in F, 


„(Ù Ar) = Yuan). in H. 


An example of vector measures is as follows. 


Example 2.41. For p € [1,oo), define u : F > L?(0,F,v) by u(A) = xal), 
V A € F. It is easy to see that p is a vector measure on (£2, F). 


Definition 2.42. Let u be an (H -valued) vector measure on (92, F). The vari- 
ation of u is the nonnegative function |u|(-) on F, defined by 


k k 
|u| (A) = sup { 5 ja(A)| a | A- U A; for some k € N and mutually 
i=1 i=1 
disjoint sets A1,- , Ay € F}, VAEF. 


If |u|(2) < +00, then we call a vector measure of bounded variation. 


It is easy to check that the vector measure u given in Example ZZ] is of 
bounded variation. 


Theorem 2.43. Let u be a vector measure of bounded variation on (Q, F). 
Then the variation |u| is a finite measure on (Q, F). 


'The following result is sometimes useful. 
Proposition 2.44. If g € L'(Q,F,v;H), u(A) = f, gdv for all A € F, then 


u is a vector measure of bounded variation on (R, F), and 


A) = [ads vAe r7. 
A 


Definition 2.45. An (H-valued) vector measure u on ((2,.F) is called v- 
continuous, denoted by u & v, if for any e > 0, there is a ô > 0 such that 
Iu CA)|g <€ whenever A € F satisfying v( A) < ô. 


The result below gives a criterion for the v-continuous vector measure. 
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Theorem 2.46. An (H-valued) vector measure u on (2, F) is v-continuous 
if and only if u(A) =0 for any A € F with v(A) =0. 


We shall need the following notion. 


Definition 2.47. We call H to have the Radon-Nikodým property w.r.t. 
(£2, .F,v), if for each v-continuous (H-valued) vector measure u of bounded 
variation on (Q,F), there exists a g € L'(Q,F,v;H) such that 


wa) = [ aav VAEF. 
A 


H is said to have the Radon-Nikodym property, if it has the Radon-Nikodym 
property w.r.t. any finite measure space. 


It is well-known that there does exist a Banach space for which the Radon- 
Nikodym property fails. The following result is due to R. S. Phillips. 


Theorem 2.48. Reflexive Banach spaces (and hence Hilbert spaces) have the 
Radon-Nikodym property. 


2.3.4 Conditional Expectation 


In this subsection, we fix a probability measure P on (Q, F), and a function 
f € LL(0; H)  L(Q, F,P; H). 


Definition 2.49. Let B € F with P(B) > 0. For any event A € F, put 


P(A| B) = SEED 


Then P(- | B) is a probability measure on (Q, F), called the conditional proba- 
bility given the event B, and denoted by Pp(-). For any given A € F, P(A | B) 
is called the conditional probability of A given B. The conditional expectation 
of f given the event B is defined by 


F 1 
(FB) = f fao gr f fae. 


Clearly, the conditional expectation of f given the event B represents the 
average value of f on B. 

In many concrete problems, it is not enough to consider the conditional 
expectation given only one event. Instead, it is quite useful to define the 
conditional expectation to be a suitable random variable. For example, when 
consider two conditional expectations E(f | B) and E(f | B°) simultaneously, 
we simply define it as a function E(f | B)xs(w) + E(f | B°)xse(w) rather 
than regarding it as two numbers. Before considering the general setting, we 
begin with the following special case. 
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Definition 2.50. Let (B;);?4 C F be a sequence of mutually disjoint sets 
in Q such that P(B;) > 0 for all i = 1,2,--- and Q = UZ; Bi. Put J = 
o{B,, B5,--- ). Then the following J-measurable function 


























Ef | 7)(w) $ EU | Be)xe, (w) 


k=1 


is called the conditional expectation of f given the o-field J. 











Clearly, when J = o{ Bj, Bo,---}, the conditional expectation E(f | 7) 
of f takes its average value in every By. Also, it is easy to check that 

















ri iu | Tae = f fd, RSL 2 oe. (2.23) 
Br By 


In the rest of this subsection, we assume that H has the Radon-Nikodym 
property. 

Now, let us consider the more general case that J is a given sub-o-field of 
F. Stimulated by (223), one defines a set function on J by 


um [ fd, V Be j. 
B 
It is easy to see that u is an (H-valued) vector measure of bounded vari- 


ation on (2,7), and u « P. Hence, one may find a (unique) function in 
L} (Q; H) 2 p1(Q, J, P; H), denoted by E(f | J), such that 


























| Bf | Za = f fdP, YBEJ. (2.24) 
B B 


This leads to the following notion: 














Definition 2.51. The (H-valued) function E(f | J), determined by (ZZA), 
is called the conditional expectation of f given the o-field J. 


We collect some basic properties of the conditional expectation as follows. 


Theorem 2.52. Let J be a sub-c-field of F. It holds that: 
1) The map E(-| J): LE(2; H) > L4 (Q; H) is linear and continuous; 
2) E(a| 7) =a, P|5-às., YV a € H; 
3) If fi, fa € L5-() with fı > fo, then 


E( fi | 7) 2 E(f2 | J), IP| 7 -a.s.; 


4) Let m,n,k EN, fy € Lu (Q;R"*") and fo € L'E(Q;R"*^) such that 
fife € LE(0;R"*F). Then 


E(fifa| I) = fE | I), IP| 7 -a.s. 
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2.3 Signed/Vector Measures, Conditional Expectation 
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Particularly, E(fi | J) = fi, Plg — a.s. Also, for any fs € Lic (Q9 Rx"), 
E(E(fs | J)f2| I) =E(fs| Z)E( 2|] J), — Plz-as.; 
5) If f is independent of J, then 
E(f|J)-—Ef, = P|;-as; 
6) Let J" be a sul-o-field of J. Then 
E(E(f | 7)| T) =E(E(f| J’) | Z) -EG| AJ,  P|g-a.s.; 


T) (Jensen’s inequality) Let 6: H — R be a convex function such that 


olf) € LE(0). Then 

































































e(E(f|J) €SE(Q(f)|J), ^ Plz-as. 
Particularly, for any p > 1, we have 

EG | Dla < EUa IE). Plas. 
provided that E| f |g; exists. 





Remark 2.53. Given two sub-o-fields J! (k = 1,2) of F, generally 






































E(E(f|J')|7*) AEE 














MF es AEs ng, 


P| 719.72-a-s. 


Proposition 2.54. Let {Fa}aca be a family of sub-o-fields of F, where A is 








a given index set. Then { 








Proof: By Theorem 22, for any s > 0, 










































































P(\E(f | Fala > s) < s 'E[ECf | Fa)la € 5 !Elflg, 
Hence 
I EG | Falade < f 
(IE(f | Fa)la >s) (IE(f | Fa)lg >s) 
< VSP((E(F | Falla > 8) + f |f|udP 
(Ifl 2/8) 
1 





"i 














p pum 
ziv 


fla f |/|udP, 
(fla>VJs) 











which yields the uniform integrability of {E(f | Fa)}aea.- 





E(f | Fa)}aca is uniformly integrable. 


Vac A. 


fladP 
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2.4 A Riesz-Type Representation Theorem 


In this section, we shall prove a Riesz-type representation theorem, which will 
play important roles in the study of both controllability and optimal control 
problems for stochastic evolution equations. 

Let (X1, Mı, u1) and (X2, M2, i2) be two finite measure spaces, and let 
H be a Banach space. Let M be a sub-o-field of Mı x Mo, and for any 
1< p,q < œ, let 


Lal(Xi; LI XS H)) = le :Xı x X2 > H | (+) is strongly M-measurable 


p 
q 
wort. fy X u2 and (J joo) dui < o}. 
Xı X2 


(2.25) 
Likewise, let 


LY (X11; L* (Xo; H)) = le :Xı x X2 > H | (+) is strongly M-measurable 


1l 
q 
w.r.t. 41 X u2 and esssup ,,e x, ei les. nada) « oo}, 
X2 
(2.26) 


D (X1; L? (Xo; H)) = le : Xı x X2 > H | ¢(-) is strongly M-measurable 


w.r.t. i X u2 and (ess sup p,e x, le(z1, £2)|Ẹr) dui < oo). 
Xi 
(2.27) 





La(Xi; L (Xo; H)) = [e : Xı x X2 > H | ¢(-) is strongly M-measurable 


wrt. fy X pg and ess sup (2, ,, ye x,x xle (1; 22)] p < oo}. 
(2.28) 
For any f € Li, (X1; L1(X5; H)), 1 € p,q < oo, we denote 


A 1 
fleas = |For, Gars exa = i. (f, [rss zadua dn 
1 2 


The definition of |floo,q:4, |flp,oo;z and |flo5,55; are similar. In a similar 
way, we may define LA,(Xo; L'(X1; H)) (1 € p,q < oo). One can show 
that both LA (X1; L*(X2; H)) and Liy (X2; L” (X1; H)) are Banach spaces. 
We shall simply denote L4,,(X1; L*(X5; R)) and |- [par by LA, (X1; L1(X32)) 
and |- |p,q, respectively. When 1 < p < oo, by the Fubini Theorem (i.e., The- 
orem EZI), one can identify Liq (X1; L"(X5; H)) and Lh, (X2; L"(X1; H)) by 
L^ x X»; H). 


E 
P 
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By Holder's inequality and Minkovski's inequality, we have the following 
inclusions: 


LG L*(X»; H)) € DaQ3 L (X2; H)), 


l<r<p<w, 1<s<q<ew, 


(2.29) 


and, 
DG LI (X2; H)) € La(X2; L” (X1; H)), LS pees on: (2.30) 


Next, for any p € [1,00], denote by p' its Hölder conjugate, i.e., 


? p=, 
oo, p=l. 


The definition of q’ € [1, oo] for q € [1, oo] is similar. 
Let us introduce the following assumption. 


Condition 2.1 For any M-measurable, nonnegative and bounded function €, 
the following function © (defined on X1 x X2) is M-measurable: 


J 
Pi _y 
q' 


E(x1,29) = (J efen, )dya(s)) ; (21,22) € X1 x X2. 
X2 
We have the following Riesz-type representation theorem for the dual of 
L^ (X3; L1 (X5; H)). 


Theorem 2.55. Let 1 < p,q < œ, and let Condition [Zl hold. Then, H* has 
the Radon-Nikodym property w.r.t. (X4 x X2, M, ui x u2) if and only if for any 
F € L'A(Xi L4(X2;H))*, there exists a unique g € ID L (X2; H*)) 
such that for any f € Lh, (Xi; L1 (X»; H)), 


F(f) = I (erza) gler 22) )u -dm (ei)dualea) — (30) 


and 


|F| r? (X1;L9(X2;H))* = gl rs! cesi (xar )y (2.32) 


Remark 2.56. Due to Theorem [55 we may make the following identifica- 
tion (for the case that H* has the Radon-Nikodym property w.r.t. (X4 x 
X2,M, Hı X u2) and Condition Z holds): 

Th (Xi; LI (X2; H))* = Lh GODS (X2; H*)), l€p,q«oo. (2.33) 


This indicates that the dual of LA,(Xi; L*(Xo; H)) can be identified as 
IP (X3; LY (Xo; H*)). 
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Remark 2.57. Surprisingly, when Condition ZI is dropped, the “only if? part 
of Theorem E55 does not hold (e.g. [234]). 


Remark 2.58. From Subsection ZZA, it is easy to see that Condition ELI is 
not needed in the “if” part of Theorem F53. 


Remark 2.59. When p,q € (1,00), a different proof of Theorem E-53 was given 
in a recent very interesting and important monograph [I51]. 


Remark 2.60. Theorem [55 is of fundamental importance in the sequel of this 
book. Indeed, this theorem and in particular its consequence (i.e., Theorem 
in Section 2.9) consist in the theoretic basis of our stochastic transposition 
method. 


The proof of Theorem [2.54 will be given in the next three subsections. 


2.4.1 Proof of the Necessity for a Special Case 


In this subsection, we prove the “only if’ part of Theorem [2.55 for the case 
that H — R. ; 
For any g € Li, (X1; L4 (X2)), define Fy : L4,(X1; L4(X2)) > R by 


Fa) -| f (21, 22)g(21, x2)dpa dus, V f € D (Xy L (X3)). 
X1X Xo 
Clearly, g + Fy is a linear map. It follows from Hólder's inequality that 
Fo CES Mn onze Qna ll pe! cxt oy VF € D OG L0). 
Hence Fy € L4(Xi; L4(X2))* and 


| Fol ro (xs ica (x2) < lglp'.a'- (2.34) 


Therefore, g +> Fy is a linear non-expanding map. Now, we show that this 
map is surjective and is an isometry. 

To show the surjectivity of g — Fy, take any F € L4(X1; L1(X3))*. Since 
XA € L4(Xi; L1(X3)) for any A € M, we may define 


v(A) = F(xa), VA c M. 


Then v is a finite signed measure on (X4 x X2, M), and v < ju x u2. By 
Theorem 33, there is a g € L4(Xi x X3) such that 


v(A) — | gdp dpe, VAEM, 
A 
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F(xa) = I gx Adu dpa, V A € M. 
X1x Xə 


Consequently, for any M-measurable simple function f, 
SU ET f (x1, 22)g(21, v2)dpidua. 
X4 x X» 


Select a sequence (4;]75.; C M such that 
Aj C Aj4i, j 212, i (m x nz) (Qs x Xs) VU As) = 0, 
j=l 


and g is bounded on each A;. For any j > 1, the following linear functional 


fo f (x1, 22)g(21, 12)X A; (£1, x2)dpa dua 
X 1x Xə 


is bounded on LA4(X;; L?(X23)). This functional agrees with F on all M- 
measurable simple functions which vanishes off A;. It follows that 


Fix) - f 4, foxasdundia, — V f € DOG DOG). (2.35) 


Since gxa,; is bounded, one has gya; € EB (Xu LY (X2)). We claim that 
g € Lia (Xa; LY (X2)), and 


Igly.e < |F lre Gira (x2) (2.36) 


To show this, without loss of generality, we assume that g Æ 0, and distinguish 
four cases. 


Case 1: p,q € (1,00). Choose 


«(| al? xa; duo) 
f= Xo 
0 


; it f lgl* x 4;du» = 0, 
X2 


1 
lg|* (sen g)x;, if f Ig" xa, du2 Æ 0, 
X2 


where 
4-1 


a= p (f. li xata) t] 


By Condition ZJ, it is easy to see that f is M-measurable. Moreover, f = 
fxa; and 
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z 2 
flea = V. on KOKA 
- U pi a( f lol" x4, dh) Lm 
Xi LJ Xa X3 
=af Jl GL. lol x4,duz) Ge f jt xan) "aya Y 
B 4f (f. biais) ta zd. 
1 2 


Substituting the above f into (235), we find that 
F(f)= f I fgxa;dp2dpı 
Xı J X2 


1 Z-1 1 
=a f Lf (f lal’ x4;dua) kl xa, duo dui 
X4 X2 Xə 


p’ 1 
ar 


= af (/ al" xa,dua) dui = d (f lc x,duz) d | 
X4 X» Xi X23 


= l9x.A;|p",9"> 
a 


SIR 


(2.37) 
which gives 
(9X4; lp" € |F| E2 Gn is(xa»*- (2.38) 
Letting j — oo in (239), and by making use of Fatou's lemma (or using the 
Monotone Convergence Theorem), one concludes (£38). 


Case 2: p = 1, 1 < q < oo. In this case, we first take p € (1, oo), and take 
f as in Case 1. Then 


Vs f Cf mma) an |f Cf, tan) i] ino 


A 
= (Xi). 
Consequently, by (2237), 


loxajlog = F(f) < |F| ri (x1:L9(X2))*|Fla,¢ 

h (2.39) 
€ Flay, (X111 (X2) H1 0) 
Letting j — oo and then letting p — 1 (which means p' — oo) in (239), we 
obtain 


lgloo.e" < [Fn Goiize (x2) 
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which is (2.30) for the case p = 1. 


Case 3: 1 < p < oo, q = 1. In this case, we first take q € (1,00), and take 
f as in Case 1. Then 


Soa =| f Cf, Wiara) am| 


< n (f. tava) t "jaa = u3(X3)* . 
Hence, by (237%), 


lgxA;l»'.e = FG) < | Flee, oni xy 





fl» 


n (2.40) 
< [Fle oui ox) n2 (X1) * 


Letting j — oo and then letting q — 1 (which means q’ — oo) in (240), we 
obtain 
lglp'oo S |F| re oiii (x3: 
which is (230) for the case q = 1. 
Case 4: p = q = 1. In this case, we still first let p,q € (1,00), and take f 
as in Case 1. Then 


i 
7 


HI = a L |f|duadpi < n ( " KOKA " aO)? pa Qc3: 


= m (X)? ua( X2)? . 


Consequently, by (E32), 





IgxA; loa! = FS) S |FIzy oni xay M ha 
A 


j (2.41) 
< |Flra r (X2) 1 (X1) ?” M(X) 7. 


Letting j — oo and then letting p,q — 1 (which means p',q' — oo) in (Z), 
we obtain 
Igloo.oo < |F| zi oni (xs 


which is (2230) for the case p,q = 1. 


Finally, (234) means that Fy € (LA4,(CX1; L1(X3)))* and since F and Fy, 
coincide on a dense subset of Liq (X1; L?(X23)), we see that F = Fy. Also, 
(2.32) follows easily from (234) and (2.30). 
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2.4.2 Proof of the Necessity for the General Case 


In this subsection, we prove the “only if? part of Theorem [55 for the general 
case. The proof is divided into two steps. 


Step 1. We show that Li (X; LY (X2; H*)) is isometrically isomorphic 
to a subspace H of L(Xi; L1 (X5; H))*. 


For any given g € I5 Xs Lt (X5; H*)), define a linear functional F} on 
L^ (X3; L4(X2; H)) as follows: 


=f " (f (21,22), g(z1, 22) ) g pe Ur dpe, 
V f € D (X5 L1(X»; H)). 


Then, by means of the Hélder inequality and similarly to (2:34), we conclude 
that F, belongs to L4,,(X1; L4(X2; H))*, and 


[Falte Gir (xany* € dla - (2.42) 


Therefore the norm of Fy, is not greater than |g|,;,y; rr. Define 
H = (F, | g € DG E (Xo; H*))). (2.43) 


It remains to prove the reverse of inequality (242). Clearly, without loss 
of generality, we may assume that g Æ 0. 

Suppose first that g — ae h¥xm, where h; is a sequence in H* and 
{E;}%, is a sequences of mutually disjoint sets from M such that (jo x 
u2)(Ei) > 0 for all i and X1 x X? = U2, Ej. Since it has been shown that 
L^; L2(X2))* = TP ai L (X3) (in the last subsection) and noting 
that 0 < |g|g« € Zh EE (X2)), we see that for any € > 0, there exists a 
nonnegative function o € LA4(X1; L4(X2)) such that 


0 « |e|p,a <1, lglp.ag* — E S | Ig zr dpi dpa. 
X 1x Xə 


Further, choose an h; € H with |h;|q = 1 such that (h;, h7 ) pr g» is nonneg- 
ative and 


Ih; |a» AE Š (hi, hi ) g ges 


€ 
lela. 
and define T 
f —  Lxsehi € Uu (X3; L1 (X5; H)). 
i=1 
It is easy to check that | f(-)| y = y(-) in X1 x X2. Hence, |flp.¢:4 = |¥lp.q < 1, 
and 
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f. (enza) 9.02) ae dian 
X4 X X2 


M 


E e» hi,h; ) n XE; dia dpo 
X 1x X2 


i=l 


E 
2 (I H* - LL )xssdi dus 
hash >| | | IW 


i=l 


M 


€ 
i | lg| r- pdpıduz — —— | edpidus > |9|p'.q;H* — 2€. 
Xıx X2 lela, XıxX2ə 


This gives 

[Folie (xara (xoi 2 dagli; 
and therefore 

[Fy xe, (X1;L9(X2;H))* = = |9|p'qyH*, 


whenever g € TP (x: LY (X2; H*)) is countably valued. 
For the general case, by Proposition 2.12, we may choose a sequence 
12;1524 C zm A (X15 L? (X2; H*)) such that each g; is countably valued and 


ma lg; — gl» qr; H* = 0. (2.44) 
We have obtained that 
[Fos |L x za (xai) = 195lp'.a's (2.45) 
and by virtue of (242), 
[Fos — Foz» (x1;L9(Xe:H))* = HFs;-olzz Gas S 19; — 9l aria 


Therefore, noting (244) and (245), we end up with 


LP (G5 LA (X2;H))* ES Fo; ln, Qa sn Qi) = a 133 lp a'stt* 
M ; ; 





^ 
= lglp',a'; n 


Hence, nr (X; L* (X2; H*)) is isometrically isomorphic to H. 


Step 2. We show that the subspace H (defined in (243)) is equal to 
LA QG L3 (X2; H))*. 


To this end, for F € L4(X1; L*(Xo; H))*, we define 
G(E)(h) = F(hxg), VEEM, hc H. (2.46) 


By 
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|F(hxg)| < [Fre Gora (xoi lI xp. 


< |F| rz, Gn iba (xo) I^| nx &lp.a: 


we see that G : M — H* and it is countably additive. Let E1,--- , Ep (k € 
N) be mutually disjoint sets from M such that X4 x X2 = DE Ej. Then 
G(E;) € H*. For any € > 0, one can find an h; € H with |h;|g = 1 such that 
G(Eij)(h;) is nonnegative and 


IG(Hilae — 5 < GO) (hi). 


It follows that 


k 


k k 
DIGE) -e < J GE) h) = F( xs.) 


i—1l 
k 
5 hix, 
i—1 


i i 
€ |F| re (x;L4(X2:H))* ta CX) ? n2 (X2)? . 


< |F| re (X1;L1(X2;H))* 








p,q;H 


Hence |G| y+(Xı x X2) < oo and G is a pı X fg-continuous vector-valued 
measure of bounded variation. Since H* has the Radon-Nikodym property 
w.r.t. (X1 x X2, M, H1 X u2), there exists a Bochner integrable function g : 
X4 x Xə — H* such that 


G(E) = f gduıdp2, VEEM. (2.47) 
E 
Clearly, if f € LA (X1; L*(X5; H)) is a simple function, then 
P(A) =f Gas) aris a) adi dua: 
X1 X X2 


Select an expanding sequence (E;]52., in M such that Ua E; = Xi x Xa 
and such that g is bounded on each E;. Fixing an arbitrary jo € N and 


noting that I (-, g(21, 2)) H,g*duıdp2 is a bounded linear functional (on 


jo 
Li, (Xi; LI(X2; H))), which agrees with F on all simple functions supported 
on E;,, we deduce that 


Jo? 


F(fxz,) -| (f (21,22), g(21, 22)X E4,) n, n dpi dpa, 
X1x X3 (2.48) 


Further, since gxg;, is bounded, one has gxg,, € Dh. (X1; LY (X2; H*)). By 
the result proved in Step 1 and (248), it follows that 
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I9X E, lpna H> = Foxe, a airs (xai SIF ne, (Xita (2-49) 


Since the inequality (2:49) holds for each jo, by the Monotone Convergence 
Theorem, we conclude that g € LX, (X1; LY (X2; H*)). 
Finally, for any f € L4,(X1; L4(X2; H)), it follows from (248) that 


F(f) = lim (f (21,22); 9(@1, 2)X5;) H,H* dpa dpg 
j—o0 X 1x Xe 
= f (f (21,22), g(£1, 32)) H+ dp dpi2 = EU 
X1 X X23 
This means that F = F}. Hence Lia (X1; L4(X2; H))* coincides with the space 
I (Xi Lt (X2; H*)). 
2.4.3 Proof of the Sufficiency 


In this subsection, we prove the “if” part of Theorem F53. 
Let G : M — H* be a 4 X u2-continuous vector measure of bounded 
variation. We shall show that there exists a g € LÀ, (X4 x X2; H*) such that 


G(E) = * ğduıdp2, V E c M. (2.50) 
E 


By Theorem £43, the variation |G| of G is a finite measure on (X, x 
X2, M). It is easy to see that |G] is a u1 X u2-continuous (IR*-valued) measure. 
Applying the Radon-Nikodym Theorem, i.e. Theorem (to |G| and py x 
u2), we can find a nonnegative function k(-) € Li4(X1 x X2) such that 


A 


Clearly, there exists a sequence {A;}72, of mutually disjoint members from 
M so that Uj2, Aj = X1 x X2, and k(-) is bounded by a constant k; > 0 on 
each Aj. It follows from (251) that 


IG|(A) € k;(ui x uz) CA), V A € M with A C A;. (2.52) 
For each j € N, define a linear functional £; on the subspace S of M-simple 
functions in LA4(X1; L4(X2; H)) as follows: 
io 
GE) = >) GEN Aj) 3), 
i=1 


where ig € N, and f = pum C,Xpg, for some x; € H and mutually disjoint 
sets EA, en Eio from M SO that Ui Ej = Xi x X». Then, by (252), 
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GG) =| $60 n A96) 





io io 
< ÑL GŒ: N Aj) leila € X GIE: n Aj)leilg 


i=l įi=1 


io 
< kj X (m x p)(Ei N Ay) eal < kyl flr (xxXa;H) 
i=1 


" 1 
< kjp (X1)? pa (X2)* | fae, (xs 1a (X2;H)) 


Thus, £; is a bounded linear functional on S. By the Hahn-Banach Theorem, 
lj can be extended to a bounded linear functional on LA4(X1; L4(X2; H)) 


(The extension is still denoted by @;). Hence there exists a g; € L^4(Xi; 
L3 (X5; H*)) such that 


Gm f Geaaesdidps Yf E Us OG DOGS B). 
XiX Xə 
We have 
G(En Aj)(x) = 4 (xe) = ] e ais iaduo. VrcH,EcAM. 

Since gj € I^. (Xi; L? (X2; H*)) is Bochner integrable, we see that 

G(En Aj)(z) = ( J aita) (o) VzcH,EcM. 
Consequently, 

G(ENA;) = f stie V Ec M. (2.53) 

Noting that A; € M, and therefore replacing E in (253) by E N Aj, we see 


that 
anAj)- f gidudu, | VE€M,jcN. 
EnA; 


Define g : X1 x X2 > H* by g(z1, 22) = gj(z1, 22) if (x1, £2) € Aj. It is 
obvious that g is strongly M-measurable w.r.t. pı X u2. Moreover, for each 
E € M and all k € N, it holds 


«(n (U 4) - f, 


Consequently, 


ddu = | rp as dida: (2.54) 
n(U5 A;) E um 
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G(E) = lim | gxys a dpidua, V E cM. (2.55) 
k—oo Jg j—173 
It remains to show that g € Li,(X1 x Xs; H*). Since |G|(X1 x X5) is 
finite, by (254) and using Proposition 244, we see that 


f. mxo a dinde < [GXi x Xa), VEEN, 
X1xX2q I= 


By the Monotone Convergence Theorem, |j|p« € Ll4(X; x X2). Hence g 
is Bochner integrable. By (255) and Theorem ZIA, we obtain (250), which 
proves the Radon-Nikodym property of H* w.r.t. (X4 x X2, M, pı X u2). 


2.5 A Sequential Banach-Alaoglu-Type Theorem in the 
Operator Version 


The classical Banach-Alaoglu Theorem (e.g. [GU, p. 130]) states that the closed 
unit ball of the dual space of a normed vector space is compact in the weak* 
topology. This theorem has an important special (sequential) version, assert- 
ing that the closed unit ball of the dual space of a separable normed vector 
space (resp., the closed unit ball of a reflexive Banach space) is sequentially 
compact in the weak* topology (resp., the weak topology). In this section, we 
shall present a sequential Banach-Alaoglu-type theorem for uniformly bound- 
ed linear operators (between suitable Banach spaces). As we shall see later, 
this result will play crucial roles in the study of the optimal control problems 
for stochastic evolution equations. 

Let X and Y be two Banach spaces. Let {yn} ; CY, y EY, {2n} C 
Y* and z € Y*. In the sequel, we denote by 


(w)- lim y, =y inY 
n— o0 
when {yn}; weakly converges to y in Y; and by 


(w*)- lim zn =z in Y* 
noo 
when {z,}°2, weakly* converges to z in Y*. Let us show first the following 
simple result: 


Lemma 2.61. Let X be a separable Banach space and let Y be a reflexive 
Banach space. Assume that {Gn}; C L(X;Y) is a sequence of bounded 
linear operators such that {G,x}°2, is bounded in Y for any given x € X. 
Then, there exist a subsequence (G4, tg; and a G € C(X;Y) satisfying that 


(w)- lim G,,z = Gx in Y, VzrcX, 


k—oo 
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(w*)- lim G7, y* = G*y* in X*, Vy'cY*, 
k—oo 


and 
IG|ecx;v) € sup |Gnlecxiv)(< oo). (2.56) 
nc 


Proof: Noting that X is separable, we can find a countable subset (1;)224 
of X such that {x1,22,---} is dense in X. Since {G,21}°2, is bounded 
in Y and Y is reflexive, there exists a subsequence (ny, C (nE94 
such that (w)- jim G (01 = yi. Now, the sequence {G or} is still 

oo k k 


bounded in Y, one can find a subsequence (ne, C (ne, such that 
(w)- um G (3:2 = ya. Generally, for each m € N, we can find a subsequence 
oo k 


(nf Dee | E {mL such that (w)- jim G (m1) Om41 = Ym+1. We now 
—00 k 


use the classical diagonalisation argument. Write nm = nim). m = 1,2,---. 


Then, {Gnn £i}; converges weakly to y; in Y. 
Let us define an operator G (from X to Y) as follows: For any x € X, 
pcc D Merc B (C) tim. Gu, ais). 
where {2;,}?2, is any subsequence of (z; 22, such that jim Tj — rin X. 
— o0 
We shall show below that G € L(X;Y). 

First, we show that G is well-defined. By the Principle of Uniform Bound- 
edness, it is clear that (G4, 12? is uniformly bounded in £(X; Y). We choose 
an M > 0 such that |G;|e(x;y) € M for all n € N. Since {2;, Jg is a Cauchy 
sequence in X, for any € > 0, there is an N > 0 such that |xi,, — zi, lx < 3; 
whenever k1, k2 > N. Hence, |Gn(xi,, — z4,)|v < € for any n € N. Then, by 
the weakly sequentially lower semicontinuity (on the norms of Banach spaces), 
we deduce that 


Vir, Yir, LY < lim IG, (zi, E Liz, JY <E, 
m-»oo 


which implies that {y;,}?2., is a Cauchy sequence in Y. Therefore, jim Yip 
00 


exists in Y. On the other hand, assume that there is another subsequence 
{xi te C Ua such that jm Ti, = x. Let yj, be the corresponding 


weak limit of Gnam xj, in Y for m — oo. Then, 
lim y; — lim y; 
keep e pa ly 
. . $ : / 
< lim lim |Gp,, (x4, —25,)|y € M lim |zi, — z;,|x 
k= m—oo k—oo 


<M lim |zi, — z|x +M lim |x — z; |x = 0. 
k—oo k—oo 


Hence, G is well-defined. 
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Next, we prove that G is a bounded linear operator. For any « € X and 
the above sequence {2;,}?2,, it follows that 


IGaly = lim |yi,|y € lim lim |G5,z;,|y € M lim |xi,|x € M[z|x. 
k—oo k= m—oo k—oo 


Hence, G is a bounded operator. Further, it is easy to see that G is linear. 
Therefore, G € £C(X;Y). 
Also, for any x € X and y* € Y", it holds that 


(x, G*y*)x,x« = (Gz, y*)y,y* = Jim (Gnv, y )v.v* = jim (e 65,9 )x, x-- 


Hence, 
(w*)- jm GV = G*y* in X*. 


Finally, from the above proof, (Z5) is obvious. This completes the proof 
of Lemma ZET. o 


Remark 2.62. Lemma 2.61] is not a direct consequence of the classical sequen- 
tial Banach-Alaoglu Theorem. Indeed, the Banach space £(X;Y) is neither 
reflexive nor separable even if both X and Y are (infinite dimensional) sepa- 
rable Hilbert spaces (See Problem 99 in [35]. 


Let (21, Mı, p1) and (£225, M2, u3) be two finite measure spaces. Let M 
be a sub-o-field of Mı x Mə. For any 1 < p,q € oo, we define a Banach 
space L^4(f21; L(25; X)) as that in (225)—(228). Fix any ri,r2,T3,T4 € 
[1,00], we denote by Lpa( Ly (21; L” (25; X)); L'E (21; L" (25; Y))) (resp. 
Lpa( X; Lj (21; L^ (2; Y)))) the vector space of all bounded, pointwise de- 
fined linear operators £ from L44((1;L'?((25; X)) (resp. X) to Li’ (21; 
L'*((25; Y)), i.e., for a.e. (w1,w2) € £ x Mo, there exists an L(w1,w2) € 
£(X; Y) satisfying that (Lu(-)) (w1, w2) = L(w1,w2)u(w1,w2), Vu(-) € Ley (0; 
L'?((25 X)) (resp. (£x)(w1,wu2) = L(wi,w2)r, V x € X). In a similar 
way, one can define the spaces Lpa (Lia, (£25; X); LR, (235 L (£25; Y))) and 
Lpd (Li. (Q1; X); Dy, (Q2; Y), etc. In the sequel, in the case that no confu- 
sion would occur, sometimes we identify £ with L(.,-). 

We now show the following sequential Banach-Alaoglu-type theorem in 
the operator version. 


Theorem 2.63. Let X be a separable Banach space, and let Y be a re- 
flexive Banach space. Let 1 < pi,p2 < oo and 1 < qm,q2 < oo, and 
let Li}, (921; L”?(22;C)) be separable. Let Condition Il hold with X1, X», 
p and q being replaced respectively by Qı, 22, qı and q2. Assume that 
{Gr} 21 C Lpa( Ly (3 LP2(Q2;X)); LR (M1; LB (M2; Y))) are uniform- 
ly bounded. Then, there exist a subsequence {Gn}; C {Gn}; and a 
G € Lg (Ly (23; L2 (22; X)); LE, (21; L2 (25; Y))) such that, for all u(-) € 
LP (£5 LP (R; X), 
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Gu(-) = (w)- lim G,,u(-) in LY, (21; LP (25; Y)). 
k—oo 
Moreover, 
I| ELE (1:92 (03: X) L (Q; L92 (22; Y ))) 


< a [Gnl e (92 (21; L22 (22;X)); L (21;L92(22:Y))) 
n 


Proof: We divide the proof into several steps. 


Step 1. Since Gn € £jya(L (23; LP (R2; X)); LY, (21; L2 (25; Y ))) (for 
each n € N), for a.e. (w1,w2) € 921 x Qo, there exists an Gn (w1,w2) € L(X; Y) 
satisfying that, for all u(-) € LA4(£21; LP? (£25; X)), 


(Gru(-)) (w1, w2) = Gn (wi, w2)u(w1, wa). (2.57) 


Write 
M = Sup [Gn etus cas soa (2:30) L8, (5142 (093) 
TL 
By Lemma ZI, we conclude that there exist a bounded linear operator G from 


TA (21; LP? (£25; X)) to LY, (Q1; LY? (25; Y)) and a subsequence {Gn}; C 
{Gn}; such that, for all u(-) € L (21; L? (£25; X)), 


Gu/(-) = (w)- jm. Uu) in DO A Le (Q2; )), (2.58) 
and 
IGu(-)| rs. (213092 (93;Y)) € Mlw(-)/ 2 oso (02:x))- (2.59) 


We claim that 


» figu; = (5 fiui) 
i=1 i=1 








" (2.60) 
= (w)- lim SU FiGn,ti — in Le (Qs; L' (Qs; Y)) 
i=1 
and 
ig ui < M| iui ; 2.61 
Du LIL (21; L92 (Q2;Y)) df Lh (Q1;LP2 (Q2;X)) ( ) 


where m € N, f; € LY (M1 x £22) and uj € LY, (1; LP2(M;X)), i = 
1,2,--- ,m. To show this, write q} = II and q$ = Di Denote by u the 
product measure of jj and u2. By Theorems 2.49 and 2.55), from (Z51)-(Z58), 


we conclude that for any v(-) € LË (Qi; LÉ (Rə; Y*)), 





2.5 A Sequential Banach-Alaoglu-Type Theorem in the Operator Version 59 


J, o, (E ftem) ts) du 


! Y,Y* 
i—l1 


Tri 


f 5,22 (Guu wa), filwr a) 2) y. dn 
1X442 j—] 


(2.62) 


m 


= lim 5 ((Gnputi) (w, w2), fi(wr, w2)v(w1, w2))y y. di 


k—oo (Q4 x (22 j=l 
m 


lim ds ui) s), (oi 2)) y. y dit 


k—oo (24 X (25 j=l 


and 
m 


na (21 x Q2 2. ((Gnx ui) (221,02), fiw, w2)v(w1, w2)}y y. di 


m 


= lim f Y (Ga (w1, W2)Us(w1, w2), fi(w1, w2)v(wi, w2)) y y... d 
(4 X (22 i=l À 


k—oo 


= lim (Gn, (w1, 02) ( 5 fien w2)Jui (w1, w2)) ;v(ws, w2)) y y. dii 


k—oo £24 X (22 m 


— lim (8s, (3 fon) Gs) onm) y d 


k—oo Mx (22 


u i (GC) nsn en tb 


(2.63) 
By (E-62)-(E-G3) and noting (259), we obtain (Z-G0)- (Z-6T). 


Step 2. It is easy to see that, each x € X can be regarded as an ele- 
ment (ie., Xo,x 9, (Jx) in Lh, (21; LP? (£25; X)). Hence, Gx makes sense and 
belongs to L%, (21; L? (25; Y)), and G is a bounded linear operator from X 
to LY: L9 (22; Y)). 

Write Bx = {x EX | jeļx < 1}. By the separability of X, it is easy to 
see that the real valued function sup (Gx) Oly is M-measurable. We claim 

rCBx 


that 


BUD | (Ga) (wi, 02), «oo, ae. (w1,w3) € Ri x Rə. (2.64) 
r€cBx 


In the rest of this step, we shall prove (2.64) by the contradiction argument. 

Assume that (264) was not true. By the measurability of the function 
sup (Gz) Oly w. r. t. M, there would exist a set A € M such that u(A) > 0 
€Bx 


x 


and that 


60 2 Some Preliminaries in Stochastic Calculus 
Sup | (Gx) (wi, w2)|, = 00, for (w1, we) € A. 
rCBx 


Let {x;}92, be a sequence in Bx such that it is dense in By. Then 


sup|(Gzi)(wi,w2)|, = sup |(Gx)(wi,w2)|, — oo, for (wi,w2) € A. 
icN rcBx 


For any n € N and i € NV {1}, we define a sequence of subsets of 2, x Nə in 
the following way: 


AQ = (n.n) ex x M | |(G21) (w1,w2)|y > n), 


AG = (toi) € (0% x 09) CU AL) | IG Gasol 2 n] 
k=1 


(2.65) 
It follows from the measurability of | (Gz) Oly that AQ € M for every i c N 


and n € N. It is clear that A C U AQ for any n € N and A(Q n ae —( 


i=1 
for i Æ j. Hence, we see that 


p» (A™) = „(LJ A? A) » 0, VncN. 
i=l i=1 


Thus, for each n € N, there is an N, € N such that 


E: (n) "m (n ~ MCA) 
uA )2-u(UU 4 ) Ec e^ (2.66) 
i=l i=l 
Write 
a) (a4, we) -Fup w1, W2)x (2.67) 


Obviously, z(?(-) is an X-valued, strongly M-measurable function. By G € 
L(I (Q3; LP (05; X)); LY (21; L2 (25; Y))) and la?) (wi,w2)|x < 1 for 
a.e. (w1,W2) € (21 x Rz, and noting (E.GU)-(E:GT), we find that 


Ig" ^ra, (21; L2 (25; Y )) 


suf f [f eenean) "anto" (2.68) 


< M (n(9:)) ^ (t) ^5, V n € N. 


1 


Now, let us choose an integer n > S is (u1(£21)) Pat 
(255)—(257), it follows that 


+ 


n 
Se 


A (ua (2))*1 *« i By 
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lGz rs (ora (Y) 


—A — € 
> (m2) * (un(022)) 8 (Ga [rs cosi cosy) 


el. —d. Nn 
= (i) 5 (o6) 337 f... Weld 


> (u()) # (ua (05) EDNT (n)) 
= MA) tony & (uat) en > M (ui (2,)) ^ (natis) P. 


2 
which contradicts the inequality (Z569). Therefore, (264) holds. 


Step 3. By (64), for a.e. (w1,02) € 2, x 22, we may define an operator 
G(w1,w2) € L(X; Y) by 


X 3 z e G(wi,wa)z = (Gx) (wi, w2). (2.69) 


Further, we introduce the following subspace of L54 (21; LP? (£25; X)): 


= [i9 E rah 


It is clear that A is dense in 244 (0, T; L”? (0; X)). We now define a linear 
operator G from X to L4,(Q1; LP (25; Y)) by 








m € N, A, € M,h; x}. 


Xx 2 ul Ka w )hi e (Gu)( (1,02) = Doxa w1, w2)G (w1, w2)h;. 
i=1 
(2.70) 
We claim that 


(Gu)(-) = (Gu), | Vu()e X. (2.71) 


Indeed, it follows from (2.57)—(2.58) that for any v(-) € Lh, (£21; L2 (25; Y *)), 
and u(-) to be of the form in (Z0), 
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I (Gu) (i, w2), (ui 2)) s. ya di 
(24 X 22 


J (X x4; (1, w)G(w1, w2)hi, v(w1,w2)}y y. du 
(21 X Qe i 


i—1l 


l.. (X xa (w1, w2) (Ghi) (w1, w2), (1, W2))y ydh 


i=1 


Il 
iM: 


| ( (Ghi) (wr, wa), X A (w1, 2) (01, w2))y y. di 
x Qo 


i=1 


3 


=y um | (Gu, (11 ton) hs x As (ut tom) ton) E T 
T REOR Mx Q2 > 


e 
ll 


Tri 


— lim (Gs, (Ww, w2) ( 5 XA; (w1, wa)hi) , v(w1, wW2))y y. di 


k—oo 24 X (2 Fm) 


Jpn) di 
(21 X Q2 


This gives (Zm). 

Recall that G is a bounded linear operator from L44 (Q1; LP? (22; X)) to 
Li, (21; L? (22; Y)). Hence, it is also a bounded linear operator from X to 
Li, (1; L? (22; Y)). By (ZZ), we see that G is a bounded linear operator 
from X to LY (21; LE (Q5; Y)). Since X is dense in (21; LP? (22; X)), 
it is clear that G can be uniquely extended as a bounded linear operator 
from L44 (91; LP? (25; X)) to LY, (1; LP (25; Y)) (We still denote by G its 
extension). By (ZA) again, we conclude that 


G=G. (2.72) 
It remains to show that 
(Gu(-)) (wi, we) = G(w1, w2)u(w1, w2), a.e. (w1,W2) € 21 x Rə, (2.73) 
for all u € L44 (Q1; LP? (25; X)). For this purpose, by the fact that X is dense 
in D1), (21; LP? (05; X)), we may assume that 
u() = $ xa Ohs, (2.74) 
i=1 
for some A; € M and h; € X, i = 1,2,--- (Note that here we assume 
neither A;(] A; = Ø nor h; Z hj for i,j = 1,2,---). For each n € N, write 
u^ (-) = S xaO) From (74), it is clear that 
il 
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u(-) = lim u"(.) in LAY (03; LP? (25; X)). (2.75) 


noo 


By (261), (Z-G9)-(Z-7U) and (2°79), it is easy to see that 


(Gu" (-)) (wi, w2) = yo Xai (w1, w2)G (w1, wo) hj (2.76) 
i=1 
is a Cauchy sequence in Lẹ (1; L? (25; Y)). Hence, by (7G) and re- 
calling that G is a bounded linear operator from L^4(f21; L??(Q2;X)) to 
LK (21; LE (22; Y)), we conclude that 


(Gu(-)) (w1,W2) = VA, (w1, w2)G (w1, w2)hi. (2.77) 
i=1 
Combining (274) and (Z-72), we obtain (ZZ). 
Finally, by (ZZ) and (273), the desired result follows. This completes the 
proof of Theorem 2:03. L1 


Remark 2.64. i) Clearly, the most difficult part in the proof of Theorem is 
to show that the weak limit operator G € Lpa (Lh), (Q1; LP? (Q5; X)); LR (21; 
L® (Qo; Y))). Note that, a simple application of Lemma Zl to the operators 
{Gn} Z; does not guarantee this point but only that G € L(I (Q1; LP? (Q5; 
X)); LY, (M1; LY (125; Y))). 

ii) By Theorem E53, it is easy to deduce that Lya (Lh (21; LP? (Q2; X)); 
LY (921; L® (Q2;Y))) is a closed linear subspace of L(I (21; LP? (25; X)); 
Is L2 (22; YA 


2.6 Stochastic Processes 


In this section, we recall some elements on stochastic processes. We fix a 
probability space (2, F, P), a Banach space H and a nonempty index set Z. 
We begin with the following definition: 


Definition 2.65. A family of (strongly F-measurable) random variables 
XÉx() 2(X (t)hez from (2,F) — (H,B(H)) is called an (H-valued) s- 
tochastic process. For any w € 2, the map t  X(t,w) is called a sample path 


(of X ). 


In what follows, we will choose Z = [0, T] with T > 0, or Z = [0, +00) unless 
otherwise stated. Also, a stochastic process will be simply called a process if no 
ambiguity. An (H-valued) process X (-) is said to be continuous (resp., cádlàg, 
i.e., right-continuous with left limits) if there is a P-null set N € F, such that 
for any w € 2\ N, the sample path X(-,w) is continuous (resp., cádlàg) in 
H. In a similar way, one can define right-continuous stochastic processes, etc. 
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In the case that H is IR" (for some m € N) with the standard topology, 
for a given stochastic process {X (t) }rez, we set 


F, 2P({X(t) 21, ,X(5) € 25), (2.78) 


iy (21, dio £j) 








where j € N, t; € Z, x; € R^ and X(t;) < x; stands for componentwise 
inequalities (i = 1,--- , j). Functions defined in (ZZA) are called the finite 
dimensional distributions of X. 

Similar to the distribution function of random variable, the finite dimen- 
sional distributions Fy, t; (£1, cj) of X include the main probability 
properties of the process. 

When H is a Hilbert space, an (H-valued) stochastic process {X(t)}iez 
is called Gaussian, if any finite linear combination Sh ai X (ti) (with a; € R 
and t; € Z (i =1,--- ,k) and k € N) is an H-valued Gaussian random variable. 

We shall use the following two notions in the sequel. 


Definition 2.66. A class of stochastic processes {X (-)}xea are called inde- 
pendent, if for any n,£ € N, {1,- ,Àn} C A and (t,--- te} C T, the 
random variables (Xx, (t1), , Xai (te)) (XL), Xan (te)) are in- 
dependent. 


Definition 2.67. Two (H-valued) processes X(-) and X(-) are said to be 
stochastically equivalent if P((.X (t) = X(t))) = 1 for any t € T. In this case, 
one is said to be a modification of the other. 


Obviously, in Definition ZUJ, X (-)'s and X(-)’s finite dimensional distribu- 
tions are the same, provided that they are stochastically equivalent, However, 
generally, the P-null set N; 2x (t) A X(t)) depends on t. Therefore, the sam- 
ple paths of X(-) and X(-) can differ significantly. The following is a simple 
example. 


Example 2.68. Let (2 = [0,1], Z = [0,1], P be the Lebesgue measure m on 
[0, 1], X (t, w) = 0, and 


cT 0, t Aw, 
Xew = 


Then X(-) and X(-) are stochastically equivalent. But, each sample path 
X(-,w) is continuous and none of the sample paths X(-,w) is continuous. 
In the present case, we actually have LJ, c7 M = Q. 


We call a family of sub-o-fields {F:}1ez in F a filtration if Fe, C Fi, for 
all t1,t9 € T with tı € tg. For any t € Z, we put 


fq CY Fe X LL] wm 
s€(t,J-oo)Z sc[0,t)nZ 
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If Fip = F, (resp. Fi- = Fi), then {Fi}ez is said to be right (resp. left) 
continuous. In the sequel, for simplicity, we write F = {F;}rez unless we want 
to emphasize what F, or I exactly is. We call (2, F, F) a filtered measurable 
space and (2,7,F,P) a filtered probability space. We say that (Q, F, F, P) 
satisfies the usual condition if (£2, 7, P) is complete, Fo contains all P-null 
sets in F, and F is right continuous. 


Remark 2.69. For each t € T, the c-algebra F; can be interpreted as the set 
of information that one has collected up to time t. 


In the rest of this section, we fix a filtration F on (Q, F). 


Definition 2.70. Let X(-) be an H -valued process. 

1) X(-) is said to be measurable if the map (t,w) — X(t,w) is strongly 
(B(T) x .F)/B(H)-measurable; 

2) X(-) is said to be F-adapted if it is measurable, and for each t € T, the 
map w œ X(t,w) is strongly F1/B(H)-measurable; 

3) X(-) is said to be F-progressively measurable if for each t € T, the 
map (s,w) r+» X(s,w) from [0,t] x 2 to H is strongly (B((0,t]) x )/B(H)- 
measurable. 


Definition 2.71. A set A € T x N is called progressively measurable w.r.t. 
F if the process x A(-) is progressive. The class of all progressively measurable 
sets is a o-algebra, called the progressive a-field w.r.t. F, denoted by F. 


'The following result is sometimes useful. 


Lemma 2.72. An (H valued) process X(-) : [0, T] x 2 — H is F-progressively 
measurable if and only if it is strongly F-measurable. 

It is clear that if X(-) is F-progressively measurable, it must be F-adapted. 
Conversely, it can be proved that, for any F-adapted process X(-), there is a 
F-progressively measurable process X(-) which is stochastically equivalent to 
X(-) (e.g. [26T, pp. 68] for the case dim H < oo. The case when dim H = oo 
can be considered similarly). For this reason, unless otherwise indicated, in 
the sequel, by saying that a process is F-adapted, we mean that it is F- 
progressively measurable. 

'The notations to be given below will be used in the rest of this book. 

For any p,q € [1, 00), write I5. (0 H) Ê IP(Q, F4, H) (t € [0, T]), and 
define 


L?(Q; L*(0, T; H)) Ê le : (0,7) x Q > H | y(-) is F-adapted 


and Cf. eoa)’ « oo); 


L4(0,T; L^(0; H)) Ê le : (0,7) x Q— H | yC) is F-adapted 


and [ (Elet) ) P< oo}. 
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Similarly, we may define (for 1 € p,q « oo) 

Lg(0;L*(0T;H), Lp(Q;L°(0,T;H)), Lg((5L*(0,7;H)) 
Lg(0,T;L'(Q;H)) Lg(0,T;L^(Q;H), LẸ (0, T; L (9; H)). 
Clearly, for 1 < p,q < œ, LE(;L9(0,T; H)) and Lg(0,T'; LP (Q; H)) are 
respectively special cases of LA (X1; L*(X5; H)) and LA4(X»; L"(X1; H)) de- 
fined in Section 224, and therefore, they are Banach spaces (with the canon- 
ical norms). In the sequel, we shall simply denote L£(Q:;L?(0,T; H)) = 
LE(0, T; L"(; H)) by LE(0, T; H); and further simply denote L£(0, T; R) by 

LO 
As a consequence of Theorem 2255 and Lemma LA, we have the following 


result (which is a Riesz-type Representation Theorem for the dual of the space 
Lg(0, T; L* (0; H))). 


Theorem 2.73. Suppose 1 € p,q « oo, and that H* has the Radon-Nikodym 
property. Then 


Lg(0, T; L4(Q; H))* = Dg (0, T; L (0; H*)), (2.79) 
where p' and q' are the Holder conjugates of p and q, respectively. 


Remark 2.74. 1) As we shall see later, Theorem is the theoretic basis of 
our stochastic transposition method. 
2) Surprisingly, as shown in [234], a quite “natural” variant of (Z), i.e., 


Dg( L(0, T; H))* = Lg (9; L" (0, T; H*)) 
is NOT correct! Note that, Condition ET fails for the latter. 


For any p € [1, 00), set 


I2(0; C([0, T]; H)) Ê le : [0,T] x 2 > H | e) is continuous, 














F-adapted and E (Ie Cl qo m.) « oo] 
and 
Cr (0, T]; L^ (2; H)) 4 le : [0T] x Q > H | y(-) is F-adapted 
and e(-) : [0, T] > LE, (2; H) is continuous}. 


One can show that both L£(£2; C([0, T]; H)) and Cp([0, T]; LP (2; H)) are Ba- 


: : - 1/1 
nach spaces with norms given by leC)L6 zzco;cco ma = ( E (Ie Ce qo m.) |p 























: 1 í S 
and |e(-)lesdo.rizecoz) = maxieto,ry (E(le(0)[57)) "^, respectively. Similar- 
ly, for any k € N, one can define the Banach spaces L5(f2; C*([0, T]; H)) and 
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C£ ([0, T]; LP (3; H)). Also, we denote by L2(Q; D([0, T]; H)) the Banach s- 
pace of all H-valued, F-adapted, càdlàg stochastic processes X(-) such that 
E(IX OE (o, 1) « oo, with the canonical norm. Similarly, one can define 
Dg((0, T]; LP(2; H)). For any X(-) € LR(Q; D([0, T]; H)), by the Dominated 
Convergence Theorem, it is easy to see that X(t) is càdlàg in Lf (2; H), 
w.r.t. t € [0, T]. Hence, 














L(A; D(0, T]; H)) c Dp((0, T]; L^(0; H)). 


In the sequel, we simply denote L5(£2; C^([0, T]; IR)) and L5((2; D([0, T]; R)) 
by LE(Q;C((0,T])) and LE(Q; D([0, T])), respectively. 

Next, let (G,G,) be a finite measure space. For any p,q,r € [1,oc), 
let LP(G; L2((2; L"(0, T; H))) be the set of all strongly G x B([0, T]) x Fr- 
measurable functions 6 : G x [0, T] x (2 — H such that for any x € G, the 
process (x, -,-) is F-adapted and 


LeU “ola, dpd) ] Ë dula) < 00, 


and let L? (G; LẸ(0, T; L2(02; H))) be the set of all strongly G x B([0, T]) x Fr- 
measurable functions ® : G x [0, T] x (2 — H such that for any x € G, the 
process @(z,-,-) is F-adapted and 


LU @ 


In a similar way, we also define 














sh 





D(z, t)|};dt) a du(z) < oo. 














L® (G; LOL (0,T; H))), GAGs IS (OL (0, T; H))), 
L” (G; LE(Q; L” (0,T; H))), L” (G; LE(Q; C([0, T]; H))), 
L*(G;Lg(0,T;L*(0;H)), L"(G;Lg(0,T;L*(Q;H)), 
) 


( 
( 
( 
L*(G;Lg(0,1;L*(0; H)), L” (G; Ce(l0, T]; L" (2; H))). 


) 
) 
) 
) 
One can show that, for any p,q,r € [1,00], both L?(G; L4(Q; L” (0, T; H))) 
and L?(G; L5 (0, T; L1(2; H))) are Banach spaces (with the canonical norms). 


Denote by Lsr(0,T; H) the set of all H-valued, F-adapted, simple pro- 
cesses of the following form: 


£—1 
f(t, w) x Se X tetera) (E(w), (2.80) 
tag 


where £ € N, 0 = to < tı < ++- < te =T, & € LE (Q; H). We simply denote 
Ls r(0,T;R) by Ls (0, T). One can show the following result. 


Lemma 2.75. For r € [1,00) and s € [1,00], the set Lsg(0, T; H) is dense 
in Lg(0, T; L*(2; H)) and Lg(2; L” (0, T; H)). 
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For any given s € [1, oo], we denote by Cos. ((0, T); L°(2; H)) the set of all 
H-valued, s-th power integrable (w.r.t. the sample point), F-adapted processes 
(-) such that ó(-) : (0, 7) > L7. (2; H) is an infinitely differentiable (vector- 
valued) function and has a compact support in (0, T). We have the following 
result. 


Lemma 2.76. For any r € [1,00) and s € [1,00], the set Cos. ((0, T); L” (2; 
H)) is dense in LẸ(0, T; L° (2; H)). 


Proof: It suffices to show that for any given f € L5(0, T; L*(2; H)) and 
€ > 0, there is a g € Coy((0, T); L (2; H)) such that |f — g|rz(o,rizs (0:2) < 
e. By Lemma ZA, we can find an f, = yy Xt, s.) (D)65 where n € N, 
0=ti «to <- <tn <tny1 =T and £i € LE, (05; H), such that 


E 
|f — fulzz(orzs (0:8) < 3 


On the other hand, for each xy, 4 we can find a g; € C§°(ti, tigi) such 


that 


i+1)? 
€ 
2n(1 + |é: 





IXj5.544) — Jile” (0,T) € 





L*(0;H)) l 
Write g = DAON Then, g € Cos ((0, T); L^? (2; H)), and 


i=1 


lf — 9lrz(o rins (0) € |f — fulzz(omizs(0:2y + Ms — 9lzztomzs(o:8) 


T 
& 
« 2 + 2. IX[6,5:)6i E giil LZ (0,7;L* (0.1) Des 
i= 


This completes the proof of Lemma 2.70. Oo 


We shall present below several sequential Banach-Alaoglu-type theorems 
(for operator-valued stochastic processes/random variables), which will be 
useful later. 

In the rest of this section, we assume that Y, is a separable Banach space, 
Y> is a reflexive Banach space, and L?(2,Fr,P) (with 1 € p < oo) is sepa- 
rable. By means of Theorems and 73, it is easy to show the following 
result. 


Theorem 2.77. Let 1 < pi,p2 < oo and 1 < qi,q9 < oo. Assume that 
(04,122. is a sequence of uniformly bounded, pointwise defined linear operators 
from LẸ (0, T; L'? (0; Y1)) to LT (0, T; L2 (9; Y2)). Then, there exist a subse- 
quence (05, 2.4, C {Gn}; and a G € Lya( LẸ (0, T; L2 (0; Y1)); LF (0, T; 


L*? (Q2; Y3))) such that, for any u(-) € Lg (0, T; L”? (9; Y1)), 


Gu(-) = (w)- lim Gnyu(-) in LẸ (0, T; L^ (0; Y2)). 
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Moreover, 


(G| EcL? (o;T;Lp2 (051) L2 (0,719 (0:Y2))) 


7 MEN Isle (0,7; L?2 (;Y1)); Ly (0,7; L32 (2:Y2))* 
nc 


From the proof of Theorem 2-63), similarly to Theorem E, it is easy to 
deduce the following result. 


Corollary 2.78. Assume that 1 < qi,q» < oo, and {Gn}; is uniform- 
ly bounded in Lpa(Yı; LẸ (0, T L2 (9; Y2))). Then, there exist a subsequence 
{Gz $81 C {Gn} and a G € Lya(¥i; LP (0, T; L2 (9; Y2))) such that 


Gy = (w)- lim G,,y in LẸ (0,T; LP (Q; Y2), | VyeY. 
—o0o0 
Moreover, |G| ey: r2 (oj; 122 (2;Y3)) Š sup nl eog (0,7; L22 (Q;¥2))° 


Proceeding exactly as in the proof of Theorem 22.63, similarly to Theorem 
Z, we can show the following two results (Hence, the detailed proof will be 
omitted). 


Theorem 2.79. Assume that 1 < py < oo, 1 < qı < oo, and {Gn}; is 
uniformly bounded in Lya (LE (Q; Yi) L9 (05 Y2)). Then, there exist a sub- 
sequence {Gn}, C {Gn} and an G € Lpa (L2, (05 YA); L (2; Y2)) such 
that 


Gu(-) = (w)- jm G,,u() in LE (9; Y2), V u(-) e LE (05 Yi). 
Moreover, || ciim (oxi taya) S Sup aleam comi 8, co) 
Theorem 2.80. Assume that 1 < py < oo, 1 < q1,q9 < œ, 0 € to < T, and 
{Gn} ds uniformly bounded in £ya(Uz, (2; Y); LF (to, T; L2 (2; Y3))). 


Then, there exist a subsequence {Gn}; C {Gn}; andaG € £o (LU. (2; 
Yi); LT (to, T; L2 (0: Y2))) such that 


Gu(-) = (w)- jim Gn,u(-) in Lg (to, T; L^(2;Y3), Vul-) € L2, (£5 Yı). 
—oo 
Moreover, 


Ilem ca) uo Tite o2) S SUP IGnleum omi) toe coa) 
TL 
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2.7 Stopping Times 


In this section, we shall introduce a special class of random variables, i.e., 
stopping times. We fix a filtered probability space (2, F,F,P) with right 
continuous filtration F = {F;}+e[0,.0) and a Banach space H. 


Definition 2.81. A map T: Q — [0,00] is called an F-stopping time, or 
simply a stopping time in the case that the filtration F is clear from the context, 
if {r € t} € Fi for any t > 0. 


Obviously, when 7 is a stopping time, it is a nonnegative random variable 
taking possibly infinite value. Define 


Fp ={AeF | An{r<theF, viz 0). 


It is clear that F, is a sub-o-field of F. The sets in F, can be thought of 
as events which may occur before the time 7. The constants, i.e., T(w) = s 
(s > 0) for every w, are stopping times and in that case F, = F, (Recall 
that F can be regarded as a set of information describing the history of some 
phenomenon and F, is the o-field of events prior to s). Stopping times thus 
appear as generalizations of constant times for each of which one can define a 
“past” which is consistent with the “past” of constant times. A stopping time 
T is a random variable such that the event “r has occurred up to t” depends 
only on the history up to £, and not on any further information in the future. 
By means of the right-continuity of the filtration, one has 


Proposition 2.82. 1) A map T: Q > [0,co] is a stopping time if and only 
if {T < t) € Fı for all t > 0. 


2) Let r be a stopping time. Then A € F» if and only if AN {T < t) EF, 
for all t > 0. 


A stopping time may be thought of as the first time when some physical 
event occurs. 


Example 2.83. Let X(-) be an F-adapted and continuous process with values 
in H. Let D C H be an open set. Then, both the first entrance time of the 
process X(-) to D, i.e., 

op(w) Sint [t > 0 | X(t,w) € D). 
and the first exit time of the process X(-) from D, i.e., 


rp(w) Sint [t >0 | X(t,w)¢ D} 


are stopping times. (Here, we agree that inf) = +00). 
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Some basic properties of stopping times are listed in the following propo- 
sition. 


Proposition 2.84. Let c, T and o; (i = 1,2,--- ) are stopping times. Then, 
1) The random variables o + T, supjen Ci, infienoi, Jim. ci and = gi 


are stopping times. Also, the events (o > T), (o > T} and po =T} belong to 
Fori 

2) The process Y (-) SrA: ds F-progressively measurable; 

3) For any A € Fs, it holds AN {0 € T} € Fr. Particularly, if o < T a.s., 
then F, C Fz; 

A) Let 6 = infiewci. Then 2; Fo, = Fe; Particularly, Fo, N Fog = 
FoiNoz * 


'The following result will be sometimes technically useful. 


Proposition 2.85. Every stopping time is the decreasing limit of a sequence 
of stopping times taking only finitely many values. 


Proof: For a stopping time 7, write 


k2* 
£ 
Tk = 2 XLE) V (+00)X{r>k} &=1,2,---. 
£—1 
It is easy to check that 7; is a stopping time and that {7,}?2, decreases to 


T. LI 


The following result provides a characterization of J-,-random variable. 


Proposition 2.86. Let 7 be a stopping time and £ be a random variable with 
values in H. Then € is F,-measurable if and only if £xq7« is J'1- measurable 
for all t > 0. 


Proof: For simplicity, we only consider the case H = R. If € is F,- 
measurable, then there is a sequence of .-;-measurable simple functions 


A z i . 
& ^» 6xa >é, as j — oo, P-a.s., 
i=1 
where 6 E R, nj EN, Aj € F, and j = 1,2,---. Obviously, EjX{r<t} = 
25 EN ain{r<t} is F;-measurable. Letting j — oo, we see that Ex,7<;} is 
also F;-measurable for all t > 0. 
Conversely, if €y,,<+} is F;-measurable for all t > 0, then 


{E<a}N{r<t}= {Exe La} E Fe, — Va«0, 
{E >a} N {rT < t} = {Expr<y »a]—-[1Expen Saf EF, — Vac. 


Therefore, {E € a} € F, for all a € R, which implies that £ is ¥,-measurable. 
L1 


72 2 Some Preliminaries in Stochastic Calculus 


Proposition 2.87. Leto and be two stopping times, and X be an integrable 
random variable with values in H. Then 


X{o>T} E(X | Fr) = E(X{o>7}X | Fr) = X{o>r} E(X | Font), 
X{o>T} E(X | F-) = E(X{o>7}X | F-) = X{o>r} E(X | Fort), 
E(E(X | Fr) | Fo) = E(X | Font). 






















































































Proof: The first equalities in the first two assertions are obvious. 
To prove the second equality in the first assertion, we note that 




















X[o»T E(X | Fr)X{oar<t} = E(X | Fred Xe, c^TEt])* 


























Since E(X | F+) is F,-measurable, by Proposition Z3GH, E(X | F-)X(r<t) is 
J,-measurable. Recall also that (c > T} € Fonar. Thus Xto>r, oar<t} 18 Fe- 
measurable. Hence x(554E(X | Fr)x{oar<t} is J;-measurable for all t > 
0. Hence, by Proposition 238 again, X{o>7}E(X | F+) is Fonr-measurable. 
Then, 



























































X(o»T7) E(X F;) = E(X{o>7} E(X | Fz) Font) 


= X{o>r}E(E(X | Fr) | Foant) = X{o>r} EG | Font), 
which proves the first assertion. The second one can be proved similarly. Fi- 
nally, 


E( E(X | Fr | Fo) = E(X{o>7} E(X | Fr) | Fo) + E(X{r>0} E(X | Fr) | Fo) 
= E(X{o>7} E(X | Foni) | Fg) T X{r>0} E( E(X Fr) | Erno) 
= X{o>r} E(X | Font) + X{r>0} E(X | Fyne) = E(X | Fro), 


which gives the third assertion. o 
Finally, we show the following result. 






















































































































































































Proposition 2.88. Let X(-) be an F-adapted process with values in H, and 
T be a stopping time. Then the random variable X(T) is F--measurable and 
the process X(T ^-) is F-adapted. 


Proof: We first prove that X(r ^-) is F-adapted. By the second con- 
clusion in Proposition 234, the process T A - is F-progressively measur- 
able. Thus for each t > 0, the map (s,w) +> (r(w) ^ s,w) is measurable 
from ([0, 2] x 42, B([0, t]) x F+) into itself. On the other hand, by the pro- 
gressively measurability of X(t), the map (s,w) +> X(s,w) is measurable 
from ([0,t] x 2, B([0,t]) x F:) into (H, B(H)). Hence, the map (s,w) 4 
X(r(w) ^ s,w) is measurable from ([0, t| x 2,B([0,t]) x F+) into (H, B(H)), 
which yields the F-progressive measurability of X (7r At). Particularly, X (r^t) 
is F;-measurable for all t > 0. 

Next, for any B € B(H), 


[X(r)e B43n(r t) - (X(r^t)e B)n(r €t] e, vt 0. 
Therefore, {X (T) € B} € F». Thus X(r) is F--measurable. Oo 
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2.8 Martingales 


Let (2,7,F,P) (with F = {F;}1ez) be a filtered probability space satisfying 
the usual condition, and denote by F the progressive o-field w.r.t. F. We first 
consider the case of real valued martingales. Then we address to the vector- 
valued martingales. 


2.8.1 Real Valued Martingales 


Let T be a time parameter set: T = {0,1,2,---} (Z = {0,1,2,--- ,co}) in the 
discrete time case or Z = [0,00) (Z = [0, 00]) in the continuous time case. We 
begin with the following notions. 


Definition 2.89. A real valued process X = {X(t)}tez is called an (.F«)iez- 
martingale, or simply a martingale (resp. supermartingale, submartingale) in 
the case that the filtration (.F«)iez is clear from the context, if 

1) X(t) is Fy-measurable and integrable (w.r.t. the probability measure P) 
for each t € T; and 

2) E(X(t) | Fs) = X(s) (resp. € X(s), > X(s)), as. for anyt,s €T 
with s « t. 














In the sequel, for any real numbers b and c, write b V c = max(b,c) and 
b^cz min(b, c). 


Example 2.90. 1) Suppose that X is an integrable random variable. Then 
{E(X | F:)}tez is a martingale. 

2) Let X(-) be a martingale (resp. submartingale) and f be a convex 
function (resp. non-decreasing convex function) so that f(X(t)) is integrable 
for each t € Z. Then f(X(-)) is a submartingale. Particularly, for any a € R, 
the processes X(-)* and X(-) V a are submartingales whenever so is X(-). 














Obviously, X(-) is a martingale if and only if it is both sub- and supper- 
martingale. Martingales are a class of important stochastic processes, which 
are easily computable and estimable. 

First, we consider the discrete time case. In this case, we write Xn instead 
of X (n), and all stopping times are assumed to be valued in {0,1,2,--- , co}. 

'The following result, called Doob's stopping theorem, is the basis to show 
the inequalities for martingales in the sequel. 


Theorem 2.91. Let {Xn}nez be a martingale (resp. supermartingale, sub- 
martingale), o and T be two bounded stopping times with o < T, a.s. Then 











E(X- | Fo) = Xo (resp. < Xo, > Xo), as. 





Proof: It suffices to consider the case of supermartingale. 
Suppose e V 7 < M, a.s. We need to show that for every A € Fs, it holds 
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] xz | xa. 
A A 


Suppose first that o < T < o +1. Put 
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B 2 AN{o =n} n{r>o} 2 An(e 2n]n(r » n] € Fa. 
It is clear that AN {r > c) = Uo Bn. Therefore 


(Xə — X-)dP = (X, — X,)dP 
An{r>a} 


I (X, — X- )dP = 
A AN{r>c} 


= >| (X, — X,)dP = > (Xn — Xn+1)dP > 0. 
n=0 Bn n=0 Bn 


In the general case, write ye = T A (c + k), for k = 0,1,2,---,M. Then k 
are {F,, }°°,-stopping times, and 
OS Yyy <1, j20,,2,:--,M-1. 


Note that yo = o and yy = T. Thus from the case discussed above, 


f xem - | xat | x, amem f x, an | xar 
A A A A A 
L1 


The following result is called Doob's inequality. 
Theorem 2.92. Let {Xn}nez be a submartingale. Then for every A > 0 and 
me T, 











XmdP < E|X |, 





AP(( max Xn > A}) i 
O<n<m { max Xn > r} 


and 





Xo| + |Xml]). 














AP({ min X, < —A}) < E 


Proof: We define a stopping time as follows 
| [min(nE€ m| X, >å} if(nE m| X, » A) z 0, 
am, if (n € m | X, 2 A) - 0. 


Obviously, o < m. Therefore 
X,dP 




















EX, > EX, = f x,de f 
{ max Xn > A} { max Xn < A} 
0<n<m 0<n<m 


> AP([ max Xn > A}) «f XmdP, 
O<n<m { max Xn < A] 
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which yields the first inequality. 
The second one is obtained from EX9 < EX-,, where 




















| [miní(n E m| X, <à}, if(nEm| X, € —A) £9, 
T—1m, if (n € m | Xn € —A) - 0. 


This completes the proof of Theorem EYZ. L1 
As a consequence of Theorem ZU, one has the following result. 


Corollary 2.93. Let {Xn}nez be a martingale or nonnegative submartingale 
such that E|X,|P < oo for some p> 1 and all n € T. Then, for every m € T 
and À > 0, 




















P(( max. [Xn] 2 AJ) < APE 





Xml”, 





and if p > 1, 




















- 
Ky 





Xml. 








; p \P 
PSU) 
E( max [Xs] ) < pal 


Proof: Obviously, {|Xn|?}nez is a submartingale and the first assertion 
follows from Theorem EYZ. 
As for the second one, we set Y = Dex |X,,|. Then, by Theorem 292, 
<n<m 


we have 


APAY > A}) < / NU (2.81) 


Hence, by (E.8TI) and Lemma 2.23, 














EY? <p f x= f Xtv23)| Xm|dPdA 
0 Q 


Y 
-»[ Xml f AP-?dAdP = Aj |Xm|Y” dP, 
Q 0 p—1Jpo 


which yields the desired result. LI 


For a real valued, F-adapted process X = ( X4] ez, and an interval [a,b], 
with —oo < a < b < oo, we set 


TQ — 0, 

7; = min{n | Xn € a}, 

7, =min{n 2 | Xn È b}, 
2 (2.82) 
Tok41 = min{n > Tək | Xn < a}, 

Tok42 = min{n > Tag 41 | Xn > b}, 





(min = +oo unless otherwise stated). It is clear that {7,,} is an increasing 
sequence of stopping times. For any m € Z, set 


76 2 Some Preliminaries in Stochastic Calculus 
Už (a, b) (w) 2 max{k | Tax (uw) < m}. 


Obviously, UŽ (a, b) is the number of upcrossings of [a,b] by {Xn} o. The 
following result is called Doob's upcrossing inequality, which is used to derive 
convergence results for martingales. 


Theorem 2.94. Let X = {Xn}nez be a submartingale. Then, 


E(UX(a,b)) < ——E[(Xm — a)* — (Xo — a)*]. 


^ b—a 





























Proof: Write Yp = (Xn — a)* and Y = {Y;}nez. Obviously, Y is a sub- 
martingale and U (a,b) = UY (0,b — a). Let 7; be defined as in (232) with 
X, a and b replaced by Y, 0 and b — a, respectively. Set 7/7, = Tn ^ m. Then, 
if 2j >m, 


2j j j-1 
Ym — Yo = 9 (Y = Yor.) = $ Yu, Ya, a) + uus Z Yu). 
n=1 n=1 n=0 


It is easy to see that the first term in the right-hand side is greater than or 

equal to (b— a)U?, (0, b — a). Also, EY, a 2 EY;4,. These two facts yield the 

desired results. Oo 
The following result characterizes the convergence of submartingales. 











Theorem 2.95. If X = {Xn}nez is a submartingale such that sup, cz; EX} < 
oo, or equivalently sup, c7 E|Xn| < oo, then Xoo = lima ,o5 Xn exists a.s., and 
Xoo is integrable. In order that X = (X4), c5 is a submartingale, i.e., 





























Xn < E(Xm | Fn), VO<n<m<o, 


it is necessary and sufficient that {X} }nez is uniformly integrable. 








Proof. Since X is a submartingale, the equivalence of sup, c; EX7 < oo 
and sup, cz E|Xn| < oo follows from 
























































sup EX} < supE|X,| = sup(2EX£? — EX,) € —EXgo + 2supEX;. 


nET nET nET nET 





























Set UŽ (a, b) = limmo UŽ (a, b). Clearly, 


s ams X a m 
{ lim Xn < lim Xn} C U (US (r,r) = œ}. 


noo 
r,r’ EQ, r<r' 


By Theorem 294, for any r,r’ € Q with r <r’, noting (Xm—r)* € Xj 4r], 
we get 


























EUS (r,r)) € lim E(Uz (r,r)) < lim E((Xm =r)" — (Xo — r)*) 


m-»oo T —T m-—»oo 




















lim E(X7, + |r| — (Xo — 7)*), 


r! — r moo 
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and this limit is finite. Consequently, 


P({ lim X, < lim Xn}) =0, 


n— oo 


which proves that Xə = lim, ,55 Xn exists a.s. By Fatou’s lemma, it follows 
that 














X; < oo, 





| |X..|dP < lim | |X,|dP < supE 
Q noo JQ nez 
which shows the integrability of Xoo. 

Now, if X, < E(Xq | Fn) for n = 0,1,2,---, then by the property of 


conditional expectation, we have 

















Xi SE(XQ | Fn), as. 




















Clearly, (IE(X 7, | Fn) }nez is uniformly integrable. Hence, so is {X+ nez. 
Conversely, if {X7 bnez is uniformly integrable, then, by 





[Xn Vv (Ca) <a + X7, Va > 0, 


one concludes that {Xn V (—a)}nez is uniformly integrable. Thus, by Theorem 
2.25), we see that 


lim X, V (—a) =X V (~a) in LLE(0). 
n—oo 


Since {Xn V (—a)}nez is a submartingale, 




















E(Xoo V (a) | Fn) = lim E(X4 V (—a) | Fn) > Xn V (-a), 


m-»oo 

















and so, letting a — +00, one gets E(X | Fn) > Xn. oO 
For the martingales, one has the following further result. 





Theorem 2.96. Let X = {Xn}nez be a martingale. Then the following con- 
ditions are equivalent. 

1) limno Xn = Xoo exists a.s. and in Ll-(Q2); 

2) Xn = E(Xs | Fn) for all n € T, as.; 

3) {Xn}nez is uniformly integrable. 
Furthermore, under one of the above conditions, X= {Xn} ,e¢ is a martin- 
gale. 











Proof: “1)=>2)”. For any m € T, we have E(Xn | Fm) = Xm for all n > m. 
Letting n — oo, we obtain that Xm = E(X% | Fm), a.s. 

“2)=>3)”. Obviously. 

*3)21)". The uniform integrability of {Xn }nez implies the boundedness 
of {Xn}nez in L4(Q) and the uniform integrability of (X; }nez. Now, the 
desired result follows from Theorems 2.95 and ZZA. Oo 

















Next, we consider, for a moment, martingales with the “reversed” time. Let 
{Fn}? a be a family of sub-o-fields of F such that Fo D F_1 D F_2 2:2 
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Koss We say X = [XJ to be a martingale (resp. supermartingale, 


n=— Co 


submartingale) if Xn is F,-adapted integrable random variable such that 











E(Xn | Fm) = Xm (resp. < Xm, = Xm) 





for every n,m € (0, —1, —2,--- ) with n > m. One has the following conver- 
gence result. 


Theorem 2.97. Let X = (X4,)9... be a submartingale. Then 

1) X-a = lim, oo Xn exists a.s.; 

2) X is uniformly integrable and lima, o5 Xn = X- in L} (N) provided 
that limn- EXn > —oo. 














Proof: The first assertion can be proved similarly to that of Theorem 2.95. 

For the second one, in view of Theorem EZS, it suffices to show the uniform 
integrability of X. For this, we fix any £ > 0 and choose an integer k such 
that 




















[EX&,, —EX,,| < e, V integers kı, ko < k. 


Then, for any A > 0 and integer n < k, 


p X, = f x+ f XndP — EX, 
{|Xn|>A} {Xn>A} {Xn>—A} 


EU xa + f XpdP - EX, +e <2 | |X;,|dP + e. 
{Xn>A} {Xn>-d} {IXal>} 


Also, 































































































1 1 1 
an _tiopyt+ Ww himc oq 3 
P({|Xn| > AS X- X,| X QEX; EXn) < x 2E Xo lm. EX,). 
Therefore, the uniform integrability of {X;,}9__., follows. Oo 


Now, we consider the continuous time case, i.e., Z = [0,00). We begin with 
the following result. 


Proposition 2.98. Let X = (X(t)hez be a submartingale. Then, QAT > 
try X(t) is finitely valued a.s. and possesses 


lim X(s) and lim  X(s), a.s., V t> 0. 
QnZz3st-4- Qnz3st-— 


Proof: Let T > 0 be given and {ri,r2,---} be an enumeration of the set 
Qn [0, T]. For every n € N, if {51, s2,--- , Sn} is the rearrangement of the set 
[ri,72,:-- , Tn} according to the natural order, then 


Yo = X(0), Y = X(si:- Vn = X (sn), Yapi = X(T) 


defines a submartingale. Write Y = (Y;];e(04,..,n41)j. By Theorems and 
Z, for each À > 0, we get 
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X 




















P({ max vi» AJ) «3 


0<i<n X(0)| + E|X (T)|), 





and for any a,b € Q with a « b, 


jä 

















E(U; (a,b) < 








E(X (T) — a)*. 








b—a 


Since this holds for every n, we have 








2 
P 3 X(t) > At) € «(E 
Um (0) > 4) € 5( 

















X(0)|+E 





X(T)I), 








and 











(ga entem (a, b)) « 














E(X(T) — a)”, 








—a 

where X|ono,r| denotes the restriction of X on the set QN [0, T]. By letting 

À and a < b run over respectively positive integers and pairs of rational, the 

assertion of the theorem follows. Oo 
The following result is quite useful. 


Theorem 2.99. Let X = (X(t)hez be a submartingale. Then, 

1) X(t t)  limgnzsr scs X(r) exists a.s. for any t € Z, and the stochastic 
process X — {X(t )hez is a cádlàg submartingale; 

2) X(t) < X(t) as., YtET; 

3) P((X(t) = X(t)}) = 1 for every t € T if and only if EX(-) is right- 


continuous. 














Proof: 1) By Proposition LJA, we see that X (t) is well-defined and F- 
adapted. d: 

To prove that {X(t)}zez is a submartingale, we fix any s > t and choose 
arbitrarily a sequence {¢,,}°2., decreasing to 0 so that t 4- £, € QNT for all 
n € N. Then, by Theorem 2.97%, we see that 

Jim IX (t + en) — X(t)]zz (o; = 0. 


Similarly, we choose a sequence (£7, )2?., decreasing to 0 such that s + &,, € 
Q nZ for all n € N. Then 


im |X(s + eh) — X(s)lrx (o) = 0. 
Hence, for any B € £i, 


[Xo t)dP = Jim. f X(t+en)dP < lir lim Po RR )dP = [Xo )dP. 


This implies that {X (f) ez is a submartingale. 
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Now, using Proposition again, we see that, for any to € J and e > 0, 
there is a 6 > 0 such that for any s € (to, to + ô) ON Q, 


IX (£5) — X(s)| < e, a.s. 
Therefore, for any r € (to, to + ô), 


X(to) —X(r|- li X (to) — <e, a.s. 
Žlto) - ŽO) = 5 jim to) - X(s) Se, as 


Hence, lim,.,4,4 X (r) = X (to), a.s. This yields the right-continuity of X. 
To show the existence of lim; ,4,.X(t), we use Proposition (to the 
submartingale {X (t))iez) to conclude that 


lm X(t), exists, a.s. 
QNT3tto— 


Thus, for any € > 0, there is a ô > 0 such that 
lX(h)-X(h)|«e;  Vhse(to—-5$)nQnz. 
By the right-continuity of X (t), the above inequality can be strengthened as 
X(t) -XUG ee — Videt 5 to) NT, 


which implies the existence of the desired left limit. 


2) It is easy to see that 
f X(t)dP < f X(tdP, VBEF, 
B B 


and hence X(t) < X(t), a.s. 
3) The “if” part. By the right-continuity of EX (-), we get 





























D = i ) = EX (t). 
A E puc b 























Note that, X(t) > X(t), a.s. Hence P(X(t) = X(t)) — 1. 
The “only if" part. Choose any sequence {sn} decreasing to t. Then, 
from the proof of Proposition LYA, we see that, 


lim X(sn)= lim  X(s) = X(t), as. VtET. 
Sn QnzZ3s—t- 


Thus, by Theorem EYA, 









































lm, EX (sn) = EX(t) = EX(t), 
which gives the right-continuity of EX(-), m 











An immediate consequence of Theorem EYJ is as follows. 
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Corollary 2.100. Let X = (X(t))iez be a submartingale such that aay 
is right-continuous. Then the process X = {X(t)}zer in Theorem J is a 
cadlag modification of X. 











The following result is a continuous counterpart of Corollary 293. 


Theorem 2.101. If X = {X(t)}1ez is a right-continuous martingale or non- 
negative submartingale so that E|X(T)|? < oo for some p > 1 and T > 0, 
then for each A > 0, 



























































P({ sup |X(t = Ah) <A PR|X(T)|?, p>, 
te(0,T] 
2.83) 
l Ta ( 
E( sup |X(£)]?) € | —— ) ELX(T)|P, >L 
(sup XOP < (757) EXP, p 


Proof: Let {An}; be a family of subsets of (Q N [0, T]) U (T) such that 
UZ] án = (Q N [0, TJ) U {T} and A,, has n elements. From Corollary Z-U3, 
we find that 





P({ sup |X(t)| > AJ) < APE 
tEAn 














Hence, 





P({ sup IX (0| > A]) € A PE|X(T)/?, p21. 
tE(QnN[0,T])U{T} 











This, together with the right continuous of |X (t)|, implies the first inequality 
n (283). The proof for the second inequality of (2233) is similar. Oo 


Corollary 2.102. Let T > 0, p € (1, 00] and X(-) € Lz(0, T) be a martingale. 
Then, there is an X(-) € LR(Q; D([0, T])) such that X(-) is a modification of 
X(-). 

Proof: By Corollary 2-100, there is a cádlàg martingale X (-) such that 
P((X(t) = X(t))) = 1 for all t € [0, T]. Thus, X(-) € LP(0, T). This, togeth- 
er with the fact that the stochastic process X(-) is cádlàg, implies X(T) € 
L^. (2. By Theorem LIOI, we conclude that E(sup,eo.rj |X(t)]P) < oo. 
Hence, X(-) € LE(Q; D([0, T])). o 

Similar to the proof of Theorem LIOI, by Theorems ZYJZYA, one can 
show the following two results. 














Theorem 2.103. Let X = {X (t) jez be a right-continuous submartingale so 
that supyez EX (t)* < oo. Then, 

1) lim; X(t) = Xoo a.s., for some Xoo € L} (Q); 

2) If (X(t)* hez is uniformly integrable, then = (X(t)),es is a sub- 
martingale; 

3) If (X(t)hez is uniformly integrable, then limiso X(t) = Xoo in 














82 2 Some Preliminaries in Stochastic Calculus 


Theorem 2.104. Let X = (X(t)hez be a martingale. Then the following 
conditions are equivalent: 

1) limo X(t) = Xoo in LQ); 

2) X(t) = E(X» | F1) a.s., Vt E T; 

3) {X (t) lez is uniformly integrable. 
Furthermore, under one of the above conditions, X = (X (t)heż is a martin- 
gale. 


The following result is a continuous version of Theorem ZY. 


Theorem 2.105. (Doob’s stopping theorem) Let X = (X(t))iez be a right- 
continuous submartingale, a. and T be two bounded stopping times such that 
P((o <7}) 21. Then X(c) and X(T) are integrable, and 


E(X (7) | Fo) > Xo, as. 














Proof: Since g and 7 are bounded, one can find a positive integer N such 
thato VT € N. Put 


2°N k 2"N k 
9n = 2 Dn X Em Loch p m5 5 pn XH Erc d) 
= 9n H or So< gn Z 2n gn- ST < 4n 











Then on € r, € N, as. By Theorem ZJ, we see that E(X (mn) | Fon) > 
X(o,), a.s. This means that, for any A € Fo, 


] xe s f Xona, Vn. 


Hence, by Theorem 2.97, we get 
lim X(r,)-— X(T), lim X(on)= X(o), in L}(Q). 
noo noo 





Consequently, f AX(r)dP > f A X (c)dP, which gives the desired result. oO 
Some consequences of Theorem 2105 are in order. 


Corollary 2.106. Let X(-) be a right-continuous, F-submartingale, and let 
[cihez be a family of right-continuous, bounded stopping times such that 
P(o < os) — 1 when t < s. Set 


X(t) = X(ox), Filed Vtci. 
Then X = (X(t)hez be a right-continuous (.F, Vie j-submartingale. 


Corollary 2.107. Let X = (X(t)hez be a martingale, and o € T be two 
stopping times satisfying o. < T, a.s. Then 


E(X(t^T) — X(tAc)|Fo)=0, VteT. 


Proof: By Proposition ZAA, X (AT) is F;-measurable. Hence, by Corollary 
2.106, for any t > 0, 


X(t ^o) = E(X(t^T) | Firo) = E(E(X(t ^T) | F2) | Fo) =E(X (tA T) | Fo). 
LI 
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2.8.2 Vector-Valued Martingales 


Let T > 0 and H be a separable Hilbert space. 


Definition 2.108. An H-valued, F-adapted process X = {X(t)}iejo,r] is 
called an F-martingale, or simply a martingale when the filtration F is clear 
from the context, if 

1) X(t) is Bochner integrable for each t € [0, T]; and 

2) E(X(t) | Fs) = X(s) a.s., for every t, s € [0, T] with s < t. 














— 


We have the following result. 


Theorem 2.109. If X(-) is an H-valued martingale such that |X(-)|u is 
right-continuous and X(T) € L4- (Q;H) for some p > 1, then, 














1 
X(t)nu > Af) € —E 
i IX())u > 4) € x; 


E( sup |X(0|5) € Gar 


te [0,T] 





AUD, p>1,rA>0, 
(2.84) 























Gd 


X(T)lz, pl. 








Proof: Noting that the process | X (-)|g is a real valued submartingale, by 
Theorem IOT, we obtain the desired results. LI 
As an immediate corollary of Corollary ZIJI, we have the following result. 


Corollary 2.110. Let X = (X(t))iez be an H-valued martingale, and o < T 
be two stopping times satisfying o < T, a.s. Then 











E(X(t^T) - X(t^c)|F,) =0, VtET. 





We give below a generalization of Corollary to the case of H-valued 
martingales. This result will play a key role in the sequel. 


Theorem 2.111. Let X(-) be an H-valued martingale such that X(T) € 
L5. (5 H) for some p € (1,oo]. Then there is an X(-) € LE(Q; D([0, T]; H)) 
such that X(-) is a modification of X(-). 


Proof: We consider only the case that p € (1,00). Assume that X(T) = 
a Sei, where (e;);24 is an orthonormal basis of H. Obviously, 

















X(t) =E(X(T)|Fi) = SEG | Fen Vte (0,7). 

i=1 

Put X;(t) = E(&; | Fe). Since X;(-) is a C-valued martingale for each i € N, 
by Corollary ZI, one can find a C-valued cádlág process X;(-) such that it 
is a modification of X;(-). Write 























-MX(te, vee [0,7]. 
i—1 
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Then X(-) is an H-valued martingale and X(T) € Lf. (Q; H). 

Let us prove that X (-) is cádlàg. For each n € N, put X,,(-) = D Xil)ei. 
Clearly, X,,(-) is cádlàg. Since X(-) and X,,(-) are martingales, X(-) — X„(-) 
is also a martingale. From the definition of Xa), there is a subsequence 
{nk} C {n}P2, such that for any k € N, 


~ ss 1 
X(T) = Xn, (Dl. (0:8) ud 3 (2.85) 


Noting that |X(-) — Xn,(-)| 
2.109, we find that 


y 18 a non-negative submartingale, by Theorem 


P({ m EO - Xm Oly = :J) 


t€[0,T" 


1 
Nk (Dre (on < k2” 





< kE 











X(T) -Xn (T)| y < k| XT) - X 





Since 375, gs < +00, by the Borel-Cantelli lemma (Theorem ZÆ), we con- 
clude that 


— E a 1 
P( Tm { sup, [Xt Xs =} =0. (2.86) 


This implies that 


" > 1 
P( lim { sup |X(t) - X,, (t)|, < z1) =1. (2.87) 
k-oo ` te[0,T] k 
Hence there exists an event o such that P(Q) = 1 and for each w € Nọ, 
there exists a positive integer N(w) such that 
1 


sup |X(t) - Xn, Oly < po VEEN). (2.88) 
te[0,T] 


Thus for w € Q, the sequence of functions { Xp, (-, w)}9°, converges uniform- 
ly to X(-,w) on [0, T]. Since for each k € N, the stochastic process Xp, (-) is 
cádlàg, there exists an event (2, with P(Q,) = 1 and for any w € Nk, the 
function X,, (-,w) is cádlàg. 

Put f2 — reo 2k. Then P(Q) = 1 and for each w € 2, the sequence 
Xn (-,w) is a sequence of cádlàg functions that converges uniformly to X (-,w) 
on [0, T]. It follows that X (-,w) is a cádlàg function for each w € (2. Hence 
X(-) is an H-valued, cádlàg stochastic process. 

Now, by Theorem ZIW, one can show that X(-) € L2(Q; D([0, T]; H)). 
This completes the proof of Theorem LIO. Li 


Finally, we introduce some Hilbert spaces which will be useful later. 
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M?([0, T]; H) = (X € L2(0, T; H) | X is a right-continuous 
F-martingale with X(0) — 0, a.s.), 
M([0, T]; H) = (X € M?((0, T]; H) | X is continuous}. 


We identify X, Y € M?((0, T]; H) if there exists a set N € F with P(N) = 0, 
such that X (tw) = Y(t,w), for allt > 0 and w ¢ N. Define 








IX[uedo,ryg = VEIX(TD), — V X e M"([0, T]; H). 








We shall simply denote V(?([0, T]; IR) and M2([0, T];IR) by M?[0,T] and 
M20, T], respectively. 
We have the following result. 


Lemma 2.112. (M? ([0, T]; H), |- [vez (q9,Tj2) is a Hilbert space, and M2((0, 
T]; H) is a closed subspace of M?([0, T]; H). 


Proof: First we note that if |X — Y |z(,rj;g) = 0, then X = Y. In- 
deed, |X — Y |(o,r;g) = 0 implies X(T) = Y(T) as. Therefore, X(t) = 
ECX (T) | Fe) = E(Y (T) | Fe) = Y (t) fort € [0, T], a.s. By the right-continuity 
of X(-) and Y (-), we conclude that X — Y. 

Next, suppose that (.X")?* , is a Cauchy sequence in M?([0, T]; H), i.e., 
lim, moo |X” — X"™ | 42 ((0,7];H) = 0. Then, by the second assertion in Theo- 
rem 2.109, we conclude that 


















































E( sup |X"(t) — X'™(t)|7,) € 4E 
0<t<T 


X(T) - X" (T). 








Hence, there is an X = (X(t))iejo,r] such that E[X^(t) — X(t)|7, — 0 as 
n — oo uniformly for t € [0,7], and we see from this that X € M?([0, T]; H) 
and |X” (t) — X(#)|m2((0,7];H) — 0 as n oo. 

Finally, it is also clear from this proof that if X" € M2([0, T]; H), then 
X € M2((0, T]; H). o 


Finally, we give below the notion of local martingale. 














Definition 2.113. An H-valued, F-adapted process X = {X(t)}iejo,r] is 
called an F-local martingale, or simply a local martingale when the filtra- 
tion F is clear from the context, if there exists a sequence of stopping times 
{Tk}; such that ry increases monotonically to T a.s. as k > +œ, and for 
each k € N, X(- A Tp) is an F-martingale. 


2.9 Brownian Motions 


Let (2,F,F,P) (with F = {Fi }tejo,œ)) be a filtered probability space sat- 
isfying the usual condition. In this section, we present a class of important 
examples of martingales, i.e., Brownian motions. 
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2.9.1 Brownian Motions in Finite Dimensions 


The Brownian motion of pollen particles in a liquid, which owes the name to 
its discovery by the English botanist R. Brown in 1827, is due to the incessant 
hitting of pollen by the much small molecules of the liquid. The hits occur 
a large number of times in any small interval of time, independently of each 
other and the effect of a particular hit is so small compared to the total effect. 
This motion has the following properties: 


1) The displacement of a pollen particle over disjoint time intervals are in- 
dependent random variables; 

2) The displacements are Gaussian random variables; 

3) The motion is continuous. 


In this subsection, we address to Brownian motions in R™ ( m € N). 
Denote by Im the identity matrix of order m x m. We begin with the following 
notion. 


Definition 2.114. A continuous, IR" -valued, F-adapted process {W(t)}i>0 is 
called an m-dimensional (standard) Brownian motion, if 

1) P((W(0) 2 0}) = 1; and 

2) For any s,t € [0, o0) with 0 € s < t < coo, the random variable W(t) — 
W(s) is independent of Fs, and W(t) — W (s) ~ N(0, (t — 8)Im). 


Similarly, one can define R™-valued Brownian motions over any time in- 
terval [a,b] or [a,b) with 0 € a < b € oo. 
If W(-) is a Brownian motion on (£2,.F, E, P), we may define 


FW 2o(W(s); sejg)cA, vtzo (2.89) 


Generally, the filtration (.F" }>0 is left-continuous, but not necessarily right- 
continuous. Nevertheless, the augmentation {ÊW so of {FW }iso by adding 
all P-null sets is continuous, and W (-) is still a Brownian motion on the (aug- 
mented) filtered probability space (2, F, (.£ so, P) (see [IG2, pp. 89 and 
122] for detailed discussion). In the sequel, by saying that F is the natural 
filtration generated by (the Brownian motion) W(-), we mean that F is gen- 
erated as (289) with the above augmentation, and hence in this case F is 
continuous. 

'The following result shows that the sample path of a Brownian motion is 
highly irregular, almost surely. 


Proposition 2.115. Let W(-) be a real valued Brownian motion. Then, for 
almost allw € R , the map t — W(t,w) is nowhere differentiable. 


Proof: It suffices to show that 


r(sg IWO o) vino 





2.9 Brownian Motions 8T 
For this purpose, for any t > 0, s > 0 and positive integer n, denote 
A 
Ata, s ={|W(t +s) — W(t)| < ns}. 
Noting that W(t + s) — W(t) ~ N(0,s), we get 


1 ns 
— Vms Ions 
where C = C(n) > 0 is a generic constant. We choose a sequence {s;}?°, so 


that limi 55:54 = 0 and 37 44/5, «oo. Then 35 4 PUn a) < ©. 
Denote 


PULS) Pode S CVs, 


Atn = lim (A1,5,5,)*- 
k—oo 


By Theorem ZA, we conclude that P(A: n) = 1. Then for any w € Ai, there 
is a k(w), such that 


W(t + sx,w) — W(t, w) 
Sk 





>n, Vk 2 k(w). 


Therefore, 


—— [wet -W(t 
ns M TS SS. ied 
s—04- S 





Put B —(),.4 Ans. Then, P(B) = 1 and 





T |W (t + s,w) zn W(t,w)| 
lim = 


s—0-4- S 


'This completes the proof. LI 


2.9.2 Construction of Brownian Motions in one Dimension 


In this subsection, we present the Lévy construction of real valued Browni- 
an motions. For a systematic introduction to the construction of Brownian 
motions in finite dimensions, we refer the readers to [I64, pp. 49-66]. 

We begin with the following assumption. 


(H) There exists a sequence of independent random variables (Xy Ye 4, on the 
probability space (2,.F, P), and Xy ~ N(0,1) for each k EN. 

We now present a probability space (Q, F, P) satisfying the assumption 
(H). For i € N, let (Qi, Fi, P:i) be a probability space on which there is a 
random variable Y; ~ (0,1). Let ([]72, 2i, [T4 Fi) be the product mea- 
surable space of {(;, F;)}S2, and P the produce measure induced by {P;}%,. 
We define a sequence of random variables {X}; on (I4 (25, DI 4 Fi, P) 
as follows: 
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oo 
Xplwi e riwe) = Yeux), — for (w we) E [[9. 


One can check that {X;,}?2., are independent, and X; ~ N (0,1). 
We first construct a Brownian motion on [0, 1]. 
Let us recall the Haar functions (hz(-) 22., on [0,1]: h1(-) = 1 in [0,1]; 


1, ifte [o. 3), 


La -1 ifte [3.1]; 


while for n € N, k € I(n) S[2^ +1,2"1 +1) AN, 








2 : k—2^—1 k-2"—1/2 
gr , if t | Qn ’ 2n p 
h&(t) = 4 20/2, itte (SI? e), 
0, otherwise. 


It is well-known that {h,}?2., forms a complete, orthonormal basis for the 
Hilbert space L?(0,1) (with the standard inner product (-,-)). Hence, 


=X (fhs) (ghk), — fae D(0,1), (2.90) 
k=1 


where (-,-) stands for the usual inner product in L?(0, 1). Let 


t 
sy (t) E hy (r)dr, te [0,1], fok-12.-. 
0 


Applying (290) to f(-) = xio, C) and g(-) = xj, ) with t, s € [0, 1], we find 


Me 


sp(t)sk(s) = min(t, s). (2.91) 
k=1 


For n € N and the sequence (X17? , given in the assumption (H), put 
a(t, w) = 3 sy lt) Xy (w (tw) € [0,1] x Q2. (2.92) 


One has the following result. 


Lemma 2.116. The sequence {W,(-)}°, (given by (292Q)) converges uni- 
formly w.r.t. t € [0,1], a.s 
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Proof: For any x > 0 and k > 2, 


2 _ x2 s2 z2 
p(flX,| ———À etd < T "a4ds«2e 7. 
(1X > 2}) =| i A Pe Fas < 20 m 


Let us choose x = 4vn k in (293). Then, 

PIX > 4VIn k}) < ae o 
From 379 < oo and the Borel-Cantelli lemma (i.e., Theorem ZA), we 
find that E 

P({ Jim. |Xx| 2 4VIn kj) = 0. 
00 

Thus, for a.e. w € 2, there is a constant K = K(w) such that 

|Xz(w)| € 4vInk, for k > K(w). (2.94) 


Put Y, Smaxger(n) |X;|. It is clear that Yp < Cyn + 1. For any € > 0, 
from the definition of s;,(-), one can find an m € N large enough such that, 
for any t € [0, 1], 


3 Xll (t)] < » Ys Yetta) te te [0 "i t) De rar 1 


k-2m 
This completes the proof of Lemma ZITA. Oo 
For t € [0,1], write 


W(t) = S s)xs. F, = o(W (s); s € [0.1]). (2.95) 
k=1 


We have the following result. 


Theorem 2.117. Let the assumption (H) hold. Then, the real valued stochas- 
tic process W (given by (295) ) is a Brownian motion on (Q, F, {Ft }te{0,1], P). 
Proof: Clearly, W(0) = 0 a.s. By Lemma ZG, it is easy to see that W(-) 


is continuous on [0, 1], a.s 
For any s,t € [0,1] satisfying 0 € s < t € 1, in view of (LUI), we have 























(os QW GA — E(e i£ D p= [si (t) —5k (s)]Xx) -JĮ z(ef&lss (05k (s)] Xx ) 

















ew Sr lr- — 9-5 ER lsk l)er (^ 


I 
=e 


k 


e- 5& ERa lR) -28r (0) 0 (2) +92 (9) 


1 


=e Ft) YEER. 
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Hence, by Definition 239, W(t) — W (s) ~ N (0,t — s). 

We now prove that for any m € N and for (t;]7*, satisfying 0 = to < 
ty <-++<tm <1, the random variables W (t4), W(t2) —W(t1),--- ,W(tm) — 
W (tm—1) are independent. For simplicity, we only consider the case that m = 
2. Using (ZM) again, we obtain that 








E (el(&1762)W (ta) +£2W (t2)]) 




















E (efl W (41) +82(W 02) -W (3) 


























= E (e! 51762) DR Sk (ta) Xp +E2 Pg sx (ta) Xx]) =|[ E (e$) sx (61) + 25x (t2)] Xe) 
k=1 





e 2 l(é1—€2) 8 (t3)--&2sk (t2)? — e7 8[(£1—62)?t1--2(6£1 — En Ents £23] 


=e 


k 
— gd O4) V£&1,6o € R. 


? 


1 


This, together with Definition and Theorem L30, implies that W (tı) and 
W (t2) — W (t1) are independent. Consequently, W (t) — W (s) is independent 
of Fs. O 


One can patch the Brownian motion (on [0,1]) constructed in Theorem 
ZI to get a Brownian motion on [0, oo). 


2.9.3 Vector-Valued Brownian Motions 


Let V be a separable, real Hilbert space. In this subsection, we address to the 
V-valued Brownian motions. 

Let Q € Li(V) be positive definite. Then, there is an orthonormal ba- 
sis {e;}72, in V and a sequence {\;}72, of positive numbers satisfying 
Moa Aj < oo and Qe; = Aje; for j = 1,2,--- (Hence, A; and e; are respec- 
tively eigenvalue and eigenvector of Q). Here, when V is an m-dimensional 
Hilbert space (for some m € N), the sequence {A;}?2; is reduced to {Aj} 74). 

Similar to Definition ZIA, one introduces the following notion. 


Definition 2.118. A continuous, V -valued, F-adapted process {W(t)}i>0 is 
called a (standard) Q-Brownian motion if 

1) P((W(0) = 0]) = 1; and 

2) For any s,t € [0,00) satisfying 0 € s < t < oo, the random variable 
W(t) — W(s) is independent of Fs, and W(t) — W (s) ~ N(0, (t — s)Q). 


In the sequel, we call A;, 2 (to, 5,777 ,tn} (for n € N) a partition of [0, T] 


i 5 A 

if0 = to «t «c «t 4 < tn = T, and write |A,,| S maxoeies a (tiui ti). 
'The following result reveals the relationship between a Q-Brownian Motion 

and its finite dimensional projections. 
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Proposition 2.119. Assume that {W(t)}is0 is a Q-Brownian motion. Then, 
for any t > 0, 


W(t) = » V A;W;(t)e;, (2.96) 


where W;(t) — Jz WO env. Furthermore, W,(-), Wa(-),--- are indepen- 


dent real valued Brownian motions, and the series in (ZUG) is convergent in 
L2(2;C((0,T];V)) for each T > 0. 


Proof: We only prove that Wi(-), W2(-),--- are independent because the 
other conclusions in Proposition ŁO can be easily verified. Assume that 
n € N and j1,:-: , j4 € N satisfying ji Æ jy for i, k € {1,2,--- ,n} with i Æ k. 
Let A, = {to,t1,--- ,te}, LEN be a partition of [0, T]. By Definition 2.60, it 
remains to prove that 


9 (Wi, (ti), , Wj, (t), ,0(W;, (t1), ,Wj, (te)) are independent. 


(2.97) 
We use the induction argument (w.r.t. £). For the case £ = 1, it is clear that 
(W; (t), --- , Wj, (t1)) is a n-dimensional Gaussian random variable. Further, 





























E(W;, (t1)W;, (t1)) = m E((W (t1), e5,)v (W (t); ej,)v) 


1 


Àj Ajk 





Jk 
Aj; 
ti (Qei ej,)v = V x; ctio. 


Hence, the covariance matrix of (W; (t1), --- ,W;, (t1)) is diagonal. By Theo- 
rem Z3, it follows that W;, (t1), --- ,W;, (t1) are independent. 

We now assume that (2297) holds for @ and prove that it also holds 
for £ + 1. Similar to the above argument, one can show that W;, (te+1) — 
Wi (te), e , Win (te+1) — Wj, (te) are independent. Further, for 1 € i € m, it 


holds that 
v (Ws. (t3) -- , Wj; (te), W5,(te+1)) 
= c (Wi, (t1) s Wj (te), Wi: (te+1) — Wi; (te)), 


Let Bik E€ B(R), 1<i<n, 1<k< £4 1. Utilizing the fact that o(W (s); s € 
[0, te]) and o(W(te41) — W(t;)) are independent, we obtain that 
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TL 


P( (N {Wa (t1) € Bu Wa (te) € Bie, Ws (tei) — W, (te) € Bis41}) 


i=1 


(LO Non) vente Walters) - Walt) € Byes)]) 











j (te+1) — Wj (te) € Biti)) 


Ds 
Ds? 
prx 
= 
= 
BO 
M 
S 
> 
A 
hd 
PN 


i=1 





(1,4) € 84] is P( {Wy tea) = Wy: (t) € Bieas})] 


k= 
= TI*([ C: Nw, Lite Bi aJ (QW te) — Wy, (te) € Bai). 


Hence the independence of W1 (-), W2(-),--- follows. Oo 


In the rest of this subsection, we consider another kind of vector-valued 
Brownian motions. 

Let {wj(-)}721 be a sequence of independent real valued, standard Brow- 
nian motions. We need the following notion. 


Definition 2.120. The following formal series (in V) 
= wt); t20, (2.98) 
j=l 


is called a (V-valued) cylindrical Brownian motion. 


Clearly, the series in (298) does not converge in V. Nevertheless, this series 
does converge in a larger space, as we shall see below. 

Let H be another separable Hilbert spaces. An operator F € L(V; H) is 
said to be a Hilbert-Schmidt operator if 3a |Fe;|?; < oo. It is easy to show 
that the number De |Fe,;|?, is independent of the choice of orthonormal 
basis {e;}72, in V. Denote by £2(V;H) the space of all Hilbert-Schmidt 
operators from V into H. When V and H are clear from the context, we 
simply write £9 for C3(V; H). One can show that, £} equipped with the inner 
product 


=) (Fej, Gej)u VEOGIL (2.99) 


j= 


= 


is a separable Hilbert space. For any v € V and h € H, it is easy to show that 
the tensor product v & h € £9 (Recall (ZIX) for the definition of v & h). 

Generally, for any bounded bilinear functional (-,-) on H, one can define 
an indefinite inner product on £$ as follows: 
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V(F,G)g = (Fej,Ge), | VE,Ge£$. (2.100) 
j=l 
It is easy to see that 
WWF, G@) col < IY IllFleglGles, (2.101) 
where 
[ol] = sup (1o(z, y)] | zy € H.|xlg < 1, lyla < 1}. (2.102) 


For more details on the Hilbert-Schmidt operators, we refer to [299] for ex- 
ample. 

Fix any sequence {j;}921 of positive numbers such that bum ls < oo. 
Let V4 be the completion of V w.r.t. the following norm: 





lflu = 3 uU env, V f € V. 
j=l 


Then, Vi is a separable Hilbert space, V C Vi and the embedding map J : 
V — Vi is a Hilbert-Schmidt operator. Let Qı = JJ*. Then Qı € £4(Vi) is 
positive definite and symmetric. 


Proposition 2.121. The series 
W(t) =X w;(t)Je; t20, (2.103) 
j=l 


converges in L2(Q;C((0,T];Vi)) for any T > 0 and defines a V; -valued, stan- 
dard Q,-Brownian motion. 


Proof: We first prove that (2103) is a Vi-valued, standard Q4-Brownian 
motion. 

Let W,(-) = $3554, w;(-)Je; for n € N. Then W,,(-) is a continuous V1- 
valued martingale. By Theorem LIUJ, for m € N with n < m, we have that 





























T" 2 m 
E sup |Wm(t) - m OR € 4E| >> wj(T)Je;| -4T Y. Ue. 
t€[0,T] j=n+1 Vi j=n+1 


This, together with the fact that IJI cvv) = Moa |Jej|{, < oo, implies 
that (W,,C) 8., is a Cauchy sequence in L2(£2; C([0, T]; V; )). Hence, its limit 
W(-) e L2(82; C([0, T]; Vi)) for any T > 0. 

Next, for any f € Vi, it is easy to see that (W (t) - W (s), f)v, is a Gaussian 
random variable for any s,t € [0, T] with s « t. Further, 
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(W(t) - W(s) fv, = (Y E[w;() — wl) Jen, fY, — 0 


1 














= 


a. 


and 











E((W (t) ux W(s), filv (W(t) = W (s), fava) 





= i 


(t = s)(Jes, fi) v (Jes, fa)v, = (t— 3) V es, J' füv (es J* fv 
j=l 


t — s)(J* fi, J* fav = (t — SJ" fi, fa) = (t— s)(Qifi, fadv, 


Hence, W(t) — W(s) ~ .N(0,(t — s)Q1). Also, it is easy to show that the 
random variable W (t) - W(s) is independent of Fs. Thus, W(-) is a Vi-valued, 
standard Q4-Brownian motion. oO 


Il 
—— i 


2.10 Stochastic Integrals 


Let T > 0 and (Q,.F, F,P) (with F = {F;}1eI0,7)) be a fixed filtered prob- 
ability space satisfying the usual condition, and denote by F the progressive 
c-field w.r.t. F. 

In this section, we shall define the integral 


f j X(t)dW (t) (2.104) 
0 


of a stochastic process X (-) w.r.t. a Brownian motion W(t). Such an integral 
will play an essential role in the sequel. Note that if for w € 2, the map t > 
W(t,w) was of bounded variation, then a natural definition of (Z104) would 
be a Lebesgue-Stieltjes type integral, simply regarding w as a parameter. 
Unfortunately, as shown in Proposition LIOS, the map t œ> W(t,w) is not 
of bounded variation for a.e. w € (2 even for the simplest case of real valued 
Brownian motions. Thus, the integral d f(s,w)dW(s,w) cannot be defined 
pointwise. However, one can define the integral for a large class of processes 
by means of the martingale property of Brownian motion. This was first done 
by K. Itó ([I55]) and is now known as Itó's integral. 


2.10.1 Itó's Integrals w.r.t. Brownian Motions in Finite 
Dimensions 


To begin with, we assume that W(-) is a one dimensional standard Brownian 
motion. 

We shall define the Itó's integral as a mapping f € L2(0, T) + I(f) € 
M20, T]. As the situation for the Lebesgue integral, we will first define the 
Itó's integral for simple integrands. 
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For a moment, assume that f € Lsg(0, T) takes the form 
= 3 Xt OSs, t € [0, T], (2.105) 
j=0 


where n € N, 0 = to < t1 <- < thoi = T, fj is F -measurable with 
sup{|f;(w)| | j € {0,--- ,n},w € R} < co. We set 


)(t,w) = Yo W(tA tj41,w) — W(t A tj,w)]. (2.106) 


We have the following key preliminary result. 


Proposition 2.122. Let f € Lsg(0, T). Then 
1) I(f) € M?2(0, T]; 
2) For any t € [0, T], E[I(f)(t)] = 0; 
3) For any t € (0, T], [I Cf)|2t0,] = || r2 (o, o; and 


4) (I(f) (0)? -f f?(s)ds is a martingale. 














Proof: Suppose that f takes the form of (2105). From (2108), it is clear 
that (f) is continuous. Further, 0€ s X t € T, 


EU UY) | Fa) = EQUO) + 10) — 15) | Fs) 
= I(f(s) +E( JO HIW EA tias) — WEA ty.) 
j-0 






































- Y HOWE Atiu) — Ws Atz) | Fo) 


0 
—I(f)(s) as. 


Hence, the conclusion 1) holds. 
For each j € {0,1,--- ,n}, 


ECFSW (£ ^ 541) — W(EAt;)]} = E(E(F;IW (t ^tj43) W(t ^t) | 75)) 
E(W 
zW 



































= E(fjE(W (tA tj+1) - W(t^t5)] | Fa )} 
—E(EW (t A tj+1) — W(t^t;)]j —0. 


Hence, EZ (f) = 0, which proves the second conclusion. 
Clearly, 
































D= M HIWA tiza) — W (EA ti) [W (EA tjt) — W(t^t;)]. 
i,j=0 


For i < j, 
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E4 fifi W (t ^ ta) — W(tA)IW(t£^t;:41) -W(t^t)]) 
E(fif;W(t ^ta) — W(tAt)IW(t^t43) -W(t^t5)] | Fey) } 
= Ef APWE A tiga) -WEA GJE(W(t A tj) - WEA 6] | 7) -0 





I.N 


= Ih 











~a 





























For i= j, 











EU IW (EA tita) WAP] 
= E(E(Z[W( ^ tjt) - WG At | Fe,)} 
- - (IW (tA taa) x W(t ^tf? | Fi;)} = (t A tj41 —tAt;) Ef?. 


















































Hence, the conclusion 3) holds. 
For any 0 € s € t, 














(OOP - f Poar |7) 














= E( [1X]? -f P(r)dr | Fs) 














+E([Z(f)(¢) — 10) + 10) ()]" — rao- f Podr | Fs) 














= (AO)? = [ Pee «x(pruxo - roe" 
«amoto - r0) |F} -x( f Pear | x) 
= que = [ Poe. 


This proves the last conclusion. LI 


Next, for any given f € L2(0, T), by Lemma ZTA, we can find a sequence 
of {fn} C Lsy(0,T) such that |f, — f|rz(o,rj > 0 as n — oo. Since 
MCfz) — ICfm)luwstor] = |n — fmlzz(o,r) for m,n € N, one deduces that 
Ufa.) FH. is a Cauchy sequence in M2[0, T] and therefore, it converges to a 
unique element X € M2[0, T]. Clearly, the process X is determined uniquely 
by f and it is independent of the particular choice of {f,}92,. This process 
is called Itó's integral of f € L2(0, T) (w.r.t. the Brownian motion W(-)). We 
shall denote it by 


t t t 
f f(s,w)dW(s,w) or simply I f(s)dW(s) or even | fdw. 
0 0 0 


It is easy to show the following result. 
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Theorem 2.123. For each f € L?(a,b) (for which f is a deterministic func- 
tion, i.e., it does not depend on w € N) with 0 € a « b € T, the Itó inte- 
gral p f (t)dW (t) is a Gaussian random variable with mean 0 and variance 


f MFG) Pat. 


Now, fix m1, mz € N. For an f = (f* Pusicm. cic € L2(0,T;R™*™2) 
and an R®-valued Brownian motion W(-) = (W 1(. ): "wn DT, wedetne 


[ (9 )dW (s (3 r f (s)aW(s "x f (s)dw( s) 


Further, for 0 < s < t, we define 


f 1o -= [ feme) -[ rom. 


Itó's integral (w.r.t. the IR"2-valued Brownian motion W(-)) has the prop- 
erties: 


Theorem 2.124. Let f,g € L2(0, T; R":*"2), a,b € R andT 2t» s 0. 
Then 
1) 
t 


t t 
| (af + bg)dW =a raw +b f gdW, as.; 
0 0 0 














«(f fdW | A) 5, as 


rm f om). 


4) The stochastic process fe fdW € M2((0,T];R™). 








Xj 




















F) -e(f UO: ct 








Fo): a.s.; 


Proof: It is easy to show that the conclusions in Theorem hold for 
simple processes. The proof for the general f and g is based on these facts 
and the definition of stochastic integral, and hence we omit it here. oO 


The following result shows that Itó's integral enjoys some local property 
though it is not defined pointwise w.r.t. the sample point. 


Lemma 2.125. Let f,g € L2(0,T;R™*™) and W(-) be an R™2-valued 
Brownian motion. Let (2; = {w € R | f(t,w) = g(t,w) for a.e. t € [0,T]}. 
Then, 


T T 
J FAW (t) -| g(t)aW(t), ae. w € £A. 
0 0 
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Proof: Without loss of generality, we may assume that g(t,w) — 0 for a.e. 
(t,w) € [0, T] x 2. Let 


T(w) Sint {¢ € [0, T) | [ lf(s,w)|?ds A o}. 


T 
Here we agree that inf? = T. Then, | X[0,7] (t)|f (t) dt = 0, a.s. For any 
0 
€ (0,1], 


(r«ü- U Cf we Pas > 0} e A. 


reQn(0,t) 


For t = 0, we have that {r < 0} = 0 € Fo. Hence, T is a stopping time. 
Define a random variable 


x T 
Š n f(s)dW (s) = fi X10,71(8)f(s)dW (s). 
0 0 


Since x[o,,4f € L2(0, T), we see that Y (7) is well defined and 





























T 
YP = : f XoF) = 0, 


which implies that Y (7) = 0, a.s. 
Ifwc "e then r(w) = T. Hence, Y (r - fof . This show 
that Ten (s)dW (s) = 0, a.e. w € R. o 


The following result will play a crucial role later. 


Lemma 2.126. Let f € L2(0,T;R™*™2) and W(-) be an R™? -valued Brow- 
nian motion. Then, for any positive numbers € and A, 


P({| L fowo n ze}) < 2 +P({ ra Hl ema dt > AP). 


(2.107) 


Proof: For simplicity, we only consider the case that mı = ma = 1. Define 
a stochastic process fa(t,w) by 


t,w), if i ,Q 2ds < A, 
ia - (^ ), dt fosse) 


0, otherwise. 


(2.108) 


Clearly, 


{| | (f roo |>e} 


c (Lf omo» JU (S roni f nowo} 


(2.109) 
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Further, by Lemma 2.125 and the definition of f)(-), we see that 


{f f()aw (t) af hawa} c (J worae> a} (2.110) 


From (Z109) and (2110), we see that 


T T T 
P{| f fi)awt)| > e}<e{| / ftat) >e} +P{ f irae > a}. 
0 0 0 
(2.111) 
By (Z108), we have fj |f,(t)/2dt € A, a.s. Hence, E ff |fy(t)|2dt € A. This, 
together with Chebyshev's inequality (in Theorem ZZA) and (11), implies 
that 














{| f awto) >e} < Fn] f i howo) + Pf I Olat > a} 

















1 T T ] A T ; 
-` F 2 MT 
-3 a | | fa (t)| a+P{ f VO] dt» at 2o 2 If (t)| dt >A}, 
which gives (2107). This completes the proof of Lemma ZIZO. Oo 


The above Itó integral d f (t)aW (t) is defined for F-adapted stochastic 
processes f (t) satisfying the condition E ra If (£)]2..,., dt < oo. Next, we will 
extend the Itó integral i f(t)dW(t) to more general F-adapted stochastic 
processes f(-). 

Let Y be a Banach space. For any p € [1, 00), denote by LP'^*(0, T; Y) the 
set of all Y-valued, F-adapted stochastic processes f(-) satisfying Jo. |f (t)]f-dt 
< OO, 8.8. 

Now, we extend the Itó integral jr f (t)aW (t) to the case that the inte- 
grand f(-) € To T: IR"1*72). For simplicity, we consider only the case 
that mı = m2 = 1, and simply denote Len. R) by ig m. The 
reasons for this generalization are as follows. First, generally speaking, it is 
very hard to check whether an F-adapted stochastic process f(-) belongs to 
L2(0, T) and it is easier to see whether f € Lz'^*(0, T). For example, when 
f(-) is a continuous, F-adapted process, then it belongs to L2/^*(0, T). Sec- 
ond, we need to consider the integral of processes f € LE(Q;L7(0,T)) for 
r € [1,2) in the study of stochastic differential/evolution equations. 

We need the following technical result. 














Lemma 2.127. Let f € to, T). Then there exists a sequence { fn}. C 
L2(0,T) such that 


T 
im f lfa(t)- fH dt- 0, a.s. (2.112) 
0 


n—- co 
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Proof: For each n € N, let us set 


fn(t,w) = pm w), if fo Gs) *ds < n, 


(2.113) 
0, otherwise. 


Clearly, fn is F-adapted and p |fn(t,w)|?dt < n, a.s., which implies that 
EJ. |fn(t)|?dt < n. Hence, fn € L2(0, T). 


Fix an w € 2. When n > p | f(t,w)|?dt, by the definition of fn, we have 
fr(t,w) = f(t,w) for all t € [0,7]. Thus, (2112) holds. o 














Now, for any given f € LÈ m by Lemma ZIZI, one can find a 
sequence (f4)29., C L2(0, T) such that (E-TT2) d Apply Lemma to 
f = fu — fm (for m,n € N) with e > 0 and à = $, we obtain that 


ed f AOAC j- f se ones 


«Sen f us mOi 5). 


Hence, ( H fs (t)dW (t) 2.4 is a Cauchy sequence in probability. This indi- 


(2.114) 


cates that the sequence { ig fn (t)dW (t) 2.4, converges in probability. There- 
fore, we can define 


T T 
n f(t)dW (t) = P- lim | fn(t)dW(t). (2.115) 
0 "n—o0o 0 


One can easily see that e (t)dW (t) is independent of the choice of { fr, 2? ,. 
Hence, the integral e (t)dW (t 24 is well-defined. If f € Lz(42; L?(0, T)) for 
p > 1, then one can show that hf (t)dW (t) e L"(2). 


Remark 2.128. If f € L2(0,T), then we can take fa = f for all n € N. In 
this case, the stochastic integral defined by (2-115) is obviously the same as 
the one defined for f € L2(0, T). This shows that the new stochastic integral 
defined by (2115) reduces to the old stochastic integral when f € L2(0, T). 


We list some basic properties of the Itó's integral of L2/^*(0, T; Rm xm). 
processes as follows. 


Theorem 2.129. Let f,g € L2'^*(0, T; R"1*"2) and W(-) be an R”? -valued 
Brownian motion. Then: 
1) For any F-stopping time c, it holds that 


t^c t 
| jaw = | Pxio,si(5)dW (8); 
0 0 
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2) For any bounded F-stopping times T and o with T X o a.s., and any 
bounded F,,-measurable random variable £1 and £s, it holds 


o 


— fdW + 2 hn 


3) The stochastic process X(- AF is a continuous, local mar- 
tingale; 
4) For any € > 0 and à > 0, 


P(( sw n iw| >eh)< Ab f ken > at). 


(2.116) 


Proof: Let us prove the last two conclusions 3) and 4). We only consider 
the case that mı = m» = 1. 
To prove 3), for any n € N, put 


Ta (w) Sint {t € [0, T) | [ If (s,w)|2ds > n). (2.117) 


Then, r, is a stopping time and limp. = T, a.s. Clearly, x(0,7,)f € 
L2(0, T) and 


xüAe)- / 7 f(dW(s) = 1 E f(s) dW (s). 


Thus, {X(t ^ Tn) }rejo,7] is a martingale, which implies that {X(t)}rejo,7] is a 
local martingale. 
For each n € N, let us set 


f (t, w), it f Aftscds <n, 


fnt, w) = (2.118) 


0, otherwise. 


It is easy to see that fn € L2(0, T). Let X €? (t ohh fa (s)daW (s). By the fourth 
conclusion in Theorem 2124, X (? (-) is continuous. B Qn, AE Fa di < 
n). The sequence (£2, X? , is increasing. Let f? á UŽ] Qn. Since dm | f (t) 2 dt 
< oo, a.s., we find that P(Q) = 1. If w € Rn, then fn(t,w) = fm(t,w) for any 
t € [0, T] and integer m > n. Thus, by Lemma 2.125, for almost all w € Qn, 
X™ (1,4) = XM (t,w), Vm » n and t € (0, T]. (2.119) 


This implies that for a.e. w € £2, limmo X €? (t, uw) exists for all t € [0, T]. 
We define a stochastic process Y (t,w) by 
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lim XC9(t,u), | ifw € 02, 
0, if wd 22. 


Then Y(-) is a continuous stochastic process. On the other hand, from the 
definition of the stochastic integral, we have that X (t) = P- limmo X"? (t). 
Therefore, for every t € [0, T], X(t) = Y (t), a.s. Hence Y (-) is a continuous 
modification of X(-). 

We now prove 4). We choose f*(-)(€ £2(0,7)) as that in (2108). Then, 
thanks to Chebyshev’s inequality (in Theorem Z.22) and Doob's inequality (in 
Theorem LION), we have 














bon n faw| > ey) 
< P( ({ sup. n (Peg aw. »0]) +P({ ({ sup, n praw| > e}) 
< ({ | OPa z TE (f paw) 

















=P({ f OLE A}) +E f “[POPar 


< (Cf not: spei " 
2.120 


which gives (Z110). o 











2.10.2 Itó's Integrals w.r.t. Vector-Valued Brownian Motions 


Let H be a separable Hilbert space with an orthonormal basis {hy }?°.,. Let 
V be another separable Hilbert space and £9 = £5(V; H). 

We consider first the case of Q-Brownian motion W(-), where Q € £4 (V) 
is given as that in Subsection (Recall that {A,}?2, and {e,}%2, are 
respectively sequences of eigenvalues and V yum of Q). By Weg 
1G, for any t, W(t) has the expansion W (t pps i V A;W;(t ej, where 


1 ; 
Wj = —— (W(t), e;)v, J= 12, , 


V ^i 
are mutually independent real valued | Pup. motions. 
For each N € N, we define Ww(t = pass HEN oT j;W;(t)ej. Let ó c 
L2(0, T; L(V; H)). Put 


X723: As f s)e;, hk) #dW;(s). 


k=1 jg=1 
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'Then, for any m,n € N with m « n, we have that 


























| 2 


| Y pe s)ej hx) ndW;(s)] 





E|Xn,N = Xm, NIA F 
































k=m+1 j=1 
: 2 
mox E (s)e;, hy) dW; (s ) 
k=m-+1 
- > Ys f [O(s)e;, ua ds 
k=m+1 j=1 0 


(2.121) 
which implies that {Xp,.}92, is a Cauchy sequence in L7... (2; H). We define 


T 
f $(s)dWy (s DS Vn f (E s)e; hy) gd W;(s) € L2. (0; H). 
k-1j-1 


For t € [0, T], put Yy(t) = Js ®(s)dWy(s). Then, for any M,N € N with 
M » N, we have that 




















EY (T) - Yu (T) | = 














Yh f tote s)ej, hx) ndW;(s s 


k=1j=N+1 


j Y x f ex (®(s)e;, hi) wdW;(s) 


k=1 j=N+1 

















| 2 

















(2.122) 
M T o9 
= 5 Aj af S| (P(s)ej, he) | ds 
j=N+1 0 k=1 
M T 4 M 
=E 5 x f |o (s)e;[,ds < PI 2 (orem) 5 Aj. 
j=N+1 79 j=N41 


This shows that {Yn (T)}9_, is a Cauchy sequence in L3 (f2; H). Hence, we 
may define the integral of 4 w.r.t. W(-) as follows: 


T T mm 
J $(s)dW(s) = Jim $(s)dWw(s), in LẸ (Q;H). (2.123) 
0 
Further, we define 


t T 
| &(s)dW(s) = | xp.gd(s)MdW(s) forte [0,7], 
0 0 


and 
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J &(s)\dW(s) = [ &(s)\dW(s) — [ $(sdW(s) for0<s<t<T. 


Similar to the case of finite dimensions, for any p € [1,0o), one may 
introduce the space L?"°°(0,T; L(V; H)) and define the stochastic integral 
of 6 € L2'^*(0, T: L(V; H)) (especially 6 € L5(62; L?(0, T; L(V; H)))) w.r.t. 
W(-). 

ue to Theorems and 2.129, one can show that the Itó's integral 
(with respect to a Q-Brownian motion W(-) valued in V) has the following 
elementary properties: 


Theorem 2.130. Let f,g € L2*(0, T; L(V; H)), a,b € R andT 2t» 57 
0. The following results hold: 
1) 


t t t 
| (af + bg)dW = af saw +b f gdW, a.s.; 
0 0 0 


2) The stochastic process Jo fdW is an H-valued, continuous, local mar- 
tingale; 
3) If f € LE(0; L?(0,T; L(V; H))), then 


«(f fdw | F,) =0, as; 


S 














A) If f,g € L£(0, T; L(V; H)), then f, fdW € M3([0, T]; H), and 


(Cf saw. f ow), |F) 


1 


=E( f üt 03 o 308) at 


























25. a.s. 





As a consequence of the conclusion 4) in Theorem 2.130, we have the 
following result (recall (Z100) for the notation v(., -) zo). 


Corollary 2.131. For any bounded bilinear functional w(-,-) on H and f,g € 
L2(0, T; L(V; H)), it holds that 


(of fawo), f sawo) |7) 


z (f vat 393, g(r, )93) gar | Fy), as 


























Proof: Since v(-,-) is a bounded bilinear functional on H, there is a P € 
£(H) such that y(x, y) = ( Px, y ) y for any x,y € H. Hence, by (299), (Z TOU) 
and the third conclusion in Theorem 2.130, it follows that 






































( 
( 
( 
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E (Cf fawo), f sawo) ies 


D 5 f sawo ?). |) 
[ 6569920 95a | F) 


[ v(f(r.-)Q8, g(r, )Q?)egdr | Fs), a.s. 


This completes the proof of Corollary 2.131. 
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O 


We now proceed with the definition of the stochastic integral w.r.t. a cylin- 
drical Wiener process. 
Let {we(:)}R1 


2 
IP|r2 (o c9) = 


For each N € N, write Wnt) = SM w;(t)ej. For any  € L2(0, 


put 


A 


be a sequence of independent real valued standard Brow- 
nian motions, and W(-) be the corresponding V-valued cylindrical Brownian 
motion (given in Definition ZIZO). Recall that L2(0, T; £9) is the Hilbert space 
consisting of all £$-valued, F-adapted processes ® such that 


oo 


























T T 
J I&(t)[2odt =J J Id (t)ey. [25 dt < oo. 
0 0 


k=1 


Kn = he f E (P(s)e;, hk) wdw;(s). 


k=1 jg=1 


(2.124) 


T; £2), 


Then, similarly to (ZIZI), for any m,n € N with m < n, we have that 














which implies that (.X;, v 122 


define 














n N T 
E| Xn = Saale = 5 5 f | (®(s)e;, he) gi | ds, 
0 


k=m+1j=1 


? ; is a Cauchy sequence in L7, (2; H). Hence, we 


T 
f * s)dWy(s) = Ym fo jenon & 2. (9:8. 


k=1 j=L 


For any t € [0, T], put Yn (t = [5 s)dWy (s). Then, similarly to (2122), for 
any M,N € N with M > M we have that 


























(T) - Yu(T) =E x [w Sale 





j=N+1 


(2.125) 
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By (2124) and (2125), (Yv (T)) ğı is a Cauchy sequence in L4 (02; H). 
Hence, we may define the integral of 9 w.r.t. W(-) as follows: 
T T DE 
f $(s)dW(s) = Jim $(s)dWx(s), in LE (9; H). 
0 


> Jo 


Similarly as in the case of finite dimensions, for any p € [1,00), one may 
introduce the space L?"°°(0,T; £9)) and define the stochastic integral of 6 € 
L2/^*(0, T; £3)) (especially 6 € L?(Q; L?(0, T; £9))) w.r.t. W(-). Further, we 
define 


t T 
f &(s)dW(s) = i xp.gd(s)dW(s), forte [0,7], 
0 0 


and 


J &(s)dW(s) = | &(s)dW(s) — [ P(s)\dW(s), forO<s<t<T. 


Remark 2.132. As we mentioned before, the series (for the definition of cylin- 
drical Brownian motion W(-)) in (298) does not converge in V. Nevertheless, 
for any operator o € £$, one can show that $9W (t) € H for any t € [0, T], 
and 


ri i Dy dW(s) = DoW (T). (2.126) 
0 


Similar to the proof of Theorems and 2.129, we can show that the 
Itó's integral (w.r.t. the cylindrical Brownian motion W(-)) has the following 
properties: 


Theorem 2.133. Let f,g € L2'^*(0, T; £9), a,b € R and T >t>s>0. The 
following results hold: 
1) 
t t t 
i (af + bg)dW = af raw +b f gdW, as.; 
0 0 0 


2) The stochastic process Jo fdW is an H-valued, continuous, local mar- 
tingale; 
3) If f € L2(Q;17(0,T; £9), then 


(f fdW | F.) 20; as 


4) If fg € Lg(0,T; £3), then fo faW € M2((0,T];H), and 


(Cf rav foe), | e) a n f ate 


Similar to Corollary ZIZI, we have the following result. 




















Xj 























Fl a.s. 
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Corollary 2.134. For any bounded bilinear functional w(-,-) on H and f,g € 
L£(0, T; £9), it holds that 


(P fdW(r f gdW(r)) (2a) 


(f vr) as Dagdr | Fo), as. 














As an easy consequence of Theorem and Corollary Z.1IU, one has 
the following Doob inequalities for stochastic integrals. 


Theorem 2.135. Let W(-) be a V-valued, Q-Brownian motion (resp. cylin- 
drical Brownian motion) and f € L2(0,T; L(V, H)) (resp. f € L2(0, T; C9)). 
Let Tr be a stopping time. Then, for any p > 1 and A » 0, 


TAT p 
f f(s)qW(s) 
0 














sup M f(s)dW (s) 2A) E 


( sup. 











and for any p> 1, 


(sup | [^ ftw) « (8| rowo, 





E 
The following result provides a useful link between Itó's and Lebesgue's 
integrals. 


Lemma 2.136. Let W(-) be a V -valued, Q-Brownian motion (resp. cylindri- 
cal Brownian motion) and f € LÈ (0, T; L(V, H)) (resp. f € if (0, T; 
£9)). Then, for any positive numbers £ and A, 


P(E se | [10v], 243) 


























sa T (2.127) 
< afan f |F(t)Q? gat) «wtf IF(t)Q? sat > A) 
(resp. 
A. cM fme) 
1 T (2.128) 
< ien IF(t)[2odt) +e({ f IF(t)[2gat > r})). 


Proof: We only consider the case that W(-) is a (V-valued) Q-Brownian 
motion. Similar to the proof of Lemma 2.126, we define a stochastic process 


falt, w) by 
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fte) if fo If (s,w)Q2 Rods <A, 
fitu) = fo = (2.129) 
0, otherwise. 


By Chebyshev's inequality (in Theorem Z:22) and Doob's inequality (in The- 
orem 2-135), similarly to (2120), we have that 


sup f rav], > eb) 
Ue. 


i sup |[ raw, > eb) +P/({ sup pi (f— Paw] >0}) 


sc[0, ü se[0,T] 


awf +P({ T If (r)Q? [jar > AJ) 
-eE n Ogar + P({ [ (OQ fdr > Aj) 


< Sean f uai) +P({ [ Lf(r)Q2|2,dr > Ap. 
(2.130) 


which gives (2127). O 



































Remark 2.187. In principle, one should introduce the stochastic integral w.r.t. 
a Brownian sheet. This integral plays an important role in the study of the 
stochastic partial differential equations perturbed by white noise depending 
on both the time and spatial variables (See [335]). One can show that such 
kind of integral equals the integral w.r.t. a cylindrical Brownian motion for 
the same integrand (e. g., [68]). Therefore, we omit the details here. 


2.11 Properties of Stochastic Integrals 


Let T > 0 and (2, F,F,P) (with F = {F;}+e[0,7)) be a fixed filtered prob- 
ability space satisfying the usual condition, and denote by F the progressive 
c-field w.r.t. F. Let H and V be two separable Hilbert spaces, Q € £1(V) be 


given as that in Subsection and write £9 2 L(V; H). Denote by I the 
identity operator on H. 


2.11.1 It6’s Formula for It6’s Processes (in a Strong Form) 


In this subsection, we present a stochastic version of the chain rule, called 
Itó's formula, which plays a fundamental role in stochastic calculus. 
We first give the notion of (H-valued) Itó process (in a strong form). 


2.11 Properties of Stochastic Integrals 109 


Definition 2.138. For any b(-) € Li/^ (0, T; H), V-valued Q-Brownian mo- 
tion (resp. cylindrical Brownian motion) W(-) ando(-) € TOP. T;£(V;H)) 
(resp. a(-) € Lg 50g T; £9)), the following form of F-adapted process 


X(t) 2 X(0) 4 hh b(s)ds + ra c (s)dW (s), t € [0, T], (2.131) 


is called an H -valued Itó process, or simply an Itó process (if the meaning is 
clear from the context). 


For any h € H, h* € H* and f € L(V;H), we define two maps 
(f hg, (I f Yy: V R as follows: 


CAP) a) = (GF) h)g, (Wf) = (QU, fQ)) pan M V. ; 

2.132 

Clearly, ( fF, hg, (h*, f )g € £(V;IR) (It is easy to check that L(V; R) = 
£2(V;R))). 

Let X, y and Z be three Banach spaces, and O and O’ be respectively 

nonempty open subsets of A and y. Let us recall that, a function f : O > y 

is called Fréchet differentiable at ro € O if there exists an A(xo) € £(X;) 


such that 
lim |f (zo +h) — f(zo) — A(xo)h|y E 


0. 
h—0 || x 





In this case, we write f;,(xo) = A(xo) and call it the Fréchet derivative of f 
at xo. A function f that is Fréchet differentiable at any point of O is said to 
be C! in O, denoted by f € C!(O; y), if the function 


fe: O> £(X;Y), meo f(x) 


is continuous. Similarly, one can define the Fréchet derivatives of higher orders 
and the space C" (O; Y) (m € N). This is done by induction so f € C"(O; y) 
if f € C!(O; y) and f, € C"-1(O; £(X;)). Especially, the Fréchet deriva- 
tive fra of fz is called the second derivative of f, and fra (xo) € L(V; £(X; V)). 
Note that £(X; £(X; Y)) is isomorphic (as a Banach space) to the Banach 
space L(Y, X; Y) of all bilinear maps from X to y, with the canonic norm. 
Similarly, for a function g : O x O' > Z and yo € O’, one can define the 
(second) mixed Fréchet derivative of g, i.e., gsy(£0, yo) € L(&, VY; Z), where 
E(X,; Z) stands for the Banach space of all maps M from X x y to Z so 
that, for any a1,a2 € C, £, 21,22 € X and y, y1, yo € Y, 


M (a121 + a2%2,y) = a1M (21, y) + a2M (2, y), 
M (x, a1y1 + a2y2) = a4M (x, Y1) + a3M (x, ya), 
with the following norm: 
|M|cæ y2) = sup {|M (z, y)|z | TE X, y € VX, |ar| 2 < 1, luly < 1}. 


The following result is known as Itô’s formula. 
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Theorem 2.139. Let X(-) be given by (ZIZI). Let F : [0,T] x H > R 
be a function such that its partial (Fréchet) derivatives Fs, Fy and F4 are 
uniformly continuous on any bounded subsets of [0, T] x H. Then, a.s., for all 
t € [0,7] (Recall (Z100) for the notation Fra(s, X (s))C.-) c9). 


F(t, X(t)) = F0.X(0) « | (Fs, X(s)),0(s) ) ydW (s) 


+f [Fe(s, X (8)) + (Fa (s, X (5), b(5)) s. s (2.133) 





EN X(s)) (o(s)Q2 ; e(5)9*) j| ds 


for the case that {W (t) iepo,r] is a Q-Brownian motion, and 
F(t, X(t) = F(0, X (0) +f (Fs, X(s)),0(s) )) ydW (s) 


+f [Fe(s, X (8) + (Fa (s. X (8). (5) gre (2.134) 





1 
+5 Fre(s, X(s)) (o(s), a(5)) so ds 
for the case that {W (t) }iejo,r] is a cylindrical Brownian motion. 


Proof: We only consider the case that W(-) is a (V-valued) cylindrical 
Brownian motion. We divide the proof into several steps. The main idea is to 
use Taylor's formula. We fix any t € [0, T]. 


Step 1. We claim that, it suffices to prove (2134) under the addition- 
al assumptions that |X(-)| n, | f; c dW|g, f, lo(r) (r)lza dr and f, |b(r)|gdr are 


uniformly bounded in [0, t] x £2, a.s. 
Indeed, for the general case, for n € N, we set 


T "Sint {se € (0, t] uf edW|. «If le(s ies] v] f |b(s Nards| >n}, 


inf = t). It is easy to see that (7" 9? , is a sequence of F-stopping times. 
y n=1 
Put 


t t 
xm axes | zw + | b^ ds, 
0 0 
where 
Xo = X(O)xqx(oyuan» 9" (s) = e(s)xp,ri(5), P" (s) = b(s)xto,-»)(s). 


Hence, |X¢|z, | fy o" aW|g, Jy lo”( 8)|z,ds and f,|b"(s)| rds are uniformly 
bounded almost surely. If the formula (rz) holds for X", then we have 
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t 
F(t, X"(t)) = F(0, X9)) +f (Fe(s, X” (s)), a" (s) )) aW (s) 


+f [FG X" (9) + (Fals; X”) C) C8) 





+5 Feels, X" ())(0" (5), 0^ (9) g| ds, a.s. 
Clearly, 
F(t, X"(t)) > F(t, X()), F(0,XP)- F(0,X(0), as. asn — oo. 


Now, for any fixed w € 2, F,(s, X(s)) is continuous w.r.t. s € [0,t] and 
therefore it is bounded by a constant C. Hence 


| Fe(s, X” (8), 0" (5) ) gy — ( Fe(s, X (5), 0 (5) ula cvm 
< Clo(s)lzs € Lg" (0. T), 


which implies that 


j IK Fo(s, X” (8)), o” (8) )) p — (Fels, X (8)) a(s) ) ula va ds > 0, as. 


as n — oo. Thus, by the third conclusion in Theorem 2.133, 


t 


P- lim | ( Fe(s,X"(s)),0"(s))) dW (s) 
0 


(2.136) 
- f ( F.(s, X ()),o(s) )ydW (s). 


Similarly, 


[weet (s, X" (s), 8" (5) sre p — (Fe(s, X(s)), 6(5)) p» ils > 0, a.s. 


as n — oo. Also, using the boundedness for any fixed w, we obtain that 
t 
] [pone + 55.6 x ene) o) as 


ftr y+ NO X(s )(e (s),0(s)) rg | ds. a.s. as n — oo. 


From (2136), we conclude that there is a subsequence (ni; 2., such that 
t 


uL o ( Fs (s, X"* (s)), o” (s) ) dW (s) 


= Í EO EO E E 
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Now, replacing n in (2135) by n; and then letting k — oo, one gets 

Step 2. Now, let us show (2134) under the additional conditions that 
Xa, | fo 0aW|g. Jo |o(r) zo dr and f, |b(r)| dr are uniformly bounded in 
[0,2] x 2 by some positive constant K. Denote by C the upper bound of 
Fi(t,x), F,(t, x) and Fyz(t, x) over L0, t] x {x € H ||v|g < K}. 

Using Taylor's expansion, we see that there is a (scalar) function e(r) 
(defined on [0, oo)), decreasing to 0 as r — 0, such that 


|F(s, x2) = Fisq) E (Fs(s, £1), v2 — X1 Ja H 


1 
~ 5 Fs (s mí) (a — $1, £2 — T1 )| 


€ e(|z2 — z1|n)|xo — 21/3, V (s, z1), (s, £2) E€ L, 


and 
|F(s5, x) — F(s1, £) — F,(s1,2)(s2 — s1)| 


< e(|s2 = $1|)|82 — si], V (51,2), (52,2) € L. 
For any h > 0 and k = 0,1,2---, put 


To = 0, 





f oaw] vf lelbgar v f lr)adr > nj. 
Tk H Tk 2 Tk 


Tk+1 = Îk41 ^ (Tk +h) ^t, 


Thayi = itl: € [74., t] | 





(inf = t). One can show that {Tẹ} is a sequence of F-stopping times, and 


Tk+1 


Tk+1 
Tk € Tk+1 € Tk +h, pi odW|. <h, / |b(s)|zds < h. 
Tk Ti 


k 
It is easy to see that 
T= F(t, X(t)) — FO, X(0)) 


=) [F (Tk, X (Tk+1)) - F (Tk, X (Tk+1))] 
k=0 


+ MFG X (Th41)) — F (Tk, X (12))I. 
k=0 


Put At, = Tk41 — Tk, AX (Tk) = X (Tk+1) ^ X (Tk), and 


Th = 25 |. (ris X (e) Am. + (se X(T), AX (Tie) ) gre n 
k=0 


45 Fes(n X (te) (AX (ra), AX())]. 
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Then 


z- 24s (c(h Are] + (2h) AX (mI) 


e(2h) [i27 (^ oaw| + DE bujau, J]; 
k=0 Tk Tk 


Note that 






































oo Tk+1 oo Tk41 t 
3» cdW| = Ey | |o(s)[20ds = e| |o(s)[2ods. 
k=0 Tk k=0 ” Tk 2 0 2 


Hence, 














oo Tk+1 2 
e(2h) 5» odW| +0 ash > 0. 
k=0 


On the other hand, 


yf rar Werf ie)lndr <a f |b(r )|gdr. 


Hence, 





lim E|Z;, — Z| = 0. 
h—0 











Step 3. In what follows, we will analyze the limit of T, in probability as 
h — 0. Clearly, the first term in Z, tends to qs F.(s, X(s))ds a.s. as h > 0. 
Since 


Tk+1 Tk+1 
Ades | odW + / bald, 


k k 
the term * 57 9 (F(T, X (Tk)), AX (Tk) ) y+” in In can be split into two 


terms. The last term tends to f(E (8, X(s)), b(s)) y. gds a.s. as h — 0; 
while the previous term reads 


SO (E:r X(n) f oaWar 
k=0 Tk 
zx C Cz (rs X (73), 0 (9) ) ydW (5) 
k-0" Tk 
E li Y GG X (9x a8) 0(8) ) AW (S) 


However, it follows from the dominated convergence theorem that 
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t oo 2 
f | 2 Fale XCD Xn = Fo GI, etos > 0 
=0 


as h — 0. Hence, 


L Us Xi) [ cdW)g. y > f (Fs, X(8)), o(s) )) dW (s) 


in probability as h — 0. 

Similarly, the term “4 375-9 Fas (Tk, X (Tk) (AX (te), AX (Tk))” in Th can 
be split into three terms. The last two terms tend to 0 a.s. as h — 0; while 
the first one reads 


eos Tk+1 Tk+1 
32 Fn XY f cdW, L odW) =T + Ta, 


k 


where = 
1 


T= 5 Er Faa (ris X(r9)) (o5). (9) ads 


k 


US es DE [Fs (ns X(r))( f am f 2 cdW) 


E Fss(r&, X (1x)) (o(s), e()) pds] 


k 
Obviously, Z, tends to in Fss(s, X (s)) (a(s), o(s)) pods a.s. as h > 0. 
2 
On the other hand, by Corollary 2.134 and using (2-101), we have 


E(Z2)* = 3» [Fass (nis X (re) ( J dd cdW, f ™ odW ) 


k=0 Tk 


i na Fia (Tk, X (Te) (e(5); a(s) pds] 


























xy 


2 











IA 
| fà 





Tk 
>» | a odW|, + Th le(s) ode) | 
z Tk Tk 


k=0 


2h t 2 t 
a | ; f saw] +E f le(s)f2ds) > 0, as h — 0. 


Hence, limpo Z2 = 0 in probability. 
Combining the above analysis, we conclude that 


e 








= 
Ez 























Tn ^ | (ri o9 + (Fals, X(8)) 0(9)) 4. 


+5 Fea(s,X(s))(0(8).0(s)) s ts f (rs X60) Daw) 


in probability as h — 0, which gives the desired result. LI 
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2.11.2 Burkholder-Davis-Gundy Inequality 


In this subsection, we shall prove the following Burkholder-Davis-Gundy in- 
equality (for stochastic integrals), which will be quite useful in the sequel 
(Compared to Lemma ZIZA, this inequality can be regarded as a further link 
between Itó's and Lebesgue's integrals). 


Theorem 2.140. For any p > 0, there exists a constant Cp > 0 such that for 
any T > 0, V -valued Q-Brownian motion (resp. cylindrical Brownian motion) 
W() and f € D5(92; L^(0, T; L(V; H))) (resp. f € Dg(Q; L^ (0, T; £3))), 


B 
2 


i) gu ( [1118104 as) (2.137) 











Xj 

















e( (sp |f f) )dW (s 


t€(0,T] 





(resp. 


























T p 
z( sup | 1e f(s)dW (s i) «C, «(f Kf GS) Reads) E (2.138) 

(; [0.7] 0 

Proof: We shall only deal with the case that W (-) is cylindrical Brownian 
motion. The case that W(-) is Q-Brownian motion can be handled similarly. 
If p = 2, then (2138) follows from Theorem 2135. Hence, we only need to 
deal with the case that p Z 2. 

Put 


af f(sdW(s,  t€ [0,7] (2.139) 
0 


We first consider the case that X is bounded. 


Step 1. In this step, we prove (2138) for p > 2. Let g(x) = |x|}, for 
x € H. Since 


p»(p—-2)zlg zex +per I, «#0, 
gas (X) = 
0, qu 
and recalling the definition of || - || in (Z102), we have that 


lless(z)] < plp — zl ?, Vee dH. 


By Itó's formula, 













































































1, f 1 f E 
UXO = 3E f aes DOG. Dagds < 5p — D | IXI fte 
1 
< zp(p— 1)E| sup |X(s)|zr- H 2 ds 
< app - DE( sup XOR? f Legs) 
1 - E y z 
< ioo 1)( sup Xx) * E(f ogas) T 


s€[(0,t] 
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This, together with Theorem 2.135, implies that 


XOR < zp- n[(z 5) mios] * [e freies) T. 


p—1 





























Ie! 















































ve- (3) le f rokas) T. (2.140) 


p—1 


— 
Ie»! 


It follows from (2140) and Theorem 2-135 again that 





























E: 
» 











E sup IX (If < ("mixtes [e( faros]. ean 


s€[0,t] 1 





Step 2. In this step, we consider the case that p € (0,2). 
By Lemma [2.23 it is easy to see that 














E( sup |X(s) LIN APTIP( sup |X(s)|g > A)dA. (2.142) 
s€[0,t] d 


By (2142) and Lemma 2-136, we get that 


E( sup |X(s)|j) 
sc [0,1] 


t oo t 
sof vote f [flRods > ran eof A3 ( f Ifl2qds ^ a?) dd. 
0 0 0 0 
(2.143) 


























Write a — S |flZods. A direct computation yields that 
2 


oo t t 2 
p f yep f [fgds > X)a- (f Lfidsds) (2.144) 
0 0 0 














and 


oo i oo In 
p xe | [ffigds ^ 2?)aa = p& f vex f |flgds ^ à?) da 
0 0 a 0 0 
a +oo 
= pE | X?71dA + pe (a? f 3d) 
0 a 


t p 
x Dog 2 og 2 2 
=E(a?) + zo») = wf f if ds)”. 
(aP) + 528r) = 3E | Vt 






















































































(2.145) 
From (2143), (2144) and (£145), we get that 






































ar 5 2 y p 5 
(sup [X (9) SE( f gds)? +5=—B( | W/lagds)"- (2.146) 


sc[0.t] 
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This concludes that (2138) holds for p € (0, 2). 
Step 3. In this step, we consider the general X. For each k € N, put 


inf {t € [0, T] | |X] >k}, if(te[0,T] |X(t))u > k} 49, 
"ls mE 
i T, otherwise. 


Write fk = X(0,7,4)f- Then by the result in Step 2, we have that 


























£( sup | e aW (s f.) sess f etga). (2.147) 


( sup. 


Letting k — +00 in both sides of (2147), by Fatou's lemma (See Theorem 
ZZO), we arrive at the desired inequality (2138). This completes the proof of 
Theorem 2.140. O 


2.11.3 Stochastic Fubini Theorem 
The following result is a stochastic version of Fubini’s theorem. 


Theorem 2.141. Let W(-) be a V-valued, Q-Brownian motion (resp. cylin- 
drical Brownian motion). Let (G,G, p) be a finite measure space and 6 : (Gx 
(0,7) x 0,6 xF) > (L(V; H),B(C(V; H))) (resp. 9: (Gx(0,T)x Q,GxF) ^ 
(£9, B(£9))) be a measurable mapping. DUST. Id (x, t, Weve tt)? (da) < 
oo (resp. allo dst.) zodt) ? u(da) < oo), a.s., then fg B(x,- -)u(dz) € 
L2'**(0,T;£(V;H)) (resp. fao P(a,-,-)u(dr) € L2'"^*(0, T; £9)), and a.s., 
Solfo Pla, t, JAW (t)|u (dz) < oo and 


T T 
Il (e,t, JAW (Huda) = | [eet outazawe). (2.148) 
GJO 0 G 


Proof: We shall only deal with the case that W (-) is cylindrical Brownian 
motion. Let us first show that (2148) holds for the functions in the following 
set 


A Z Z n n n 
Sf On - 31 Y Pes o | n EN, ak € LE, (2: L9), 


j=l k=1 


8; are real valued, bounded G-measurable functions, and 
i5j. 5844) is a partition of [0, TI}. 


By Remark ZIZA, for any n in the above form, 
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f, [? «(2t JAW (£)dp(z) 


-f5 Y 5 (a)r ag tog Wt) — WGp] du) 
Pw S : (2.149) 


TL 


s d Xb ndi z)dp(x Jaz [w (sk+1) — W(sg)] 


=1 


[e )du(z)dW(t). 


Next, we consider the general case. We claim that there exist (9,129. , C S 
such that 


T 1/2 
P- lim (f |o, (x, t,-) — B(x, t, JIgat) pda) = 0. (2.150) 
G \Jo : 


noo 


To see this, for each n € N, let us set 


; T 1/2 
P(w if (x,t, w)|Zodt dx) <n, 
eese) fo (Sp OLAN MDS a oy 
0 otherwise. 


It is easy to see that fo n [As (2, t, w) 2. dt) ^ (da) <n, as. Hence, An € 
2 
LG(G; L& (£2; L? (0, T; £3))). Fix an w € 2. By (ZIA), it is easy to see that 


T 1/2 
lim (f [As (2, t, -) — d(z,t, ‘)[2qat) u(dx)=0, as. (2.152) 
noo G 0 2 

By the definition of Bochner's integral, for each m € N, one can find q;(-,-) € 
Li(2; L?(0, T; £3)) (i = 1,2,--- ,m) and E; € G such that 


Jim, f Matsa) - Saxe Gerne) =. (2153) 
By Lemma EZ, the set Ls p(0, T; £9) is dense in Ly(Q; L?(0, T; £9)). This 
fact, together with LE- (2153), gives (Z150) for suitably chosen 9, € S. 

We claim that Salle 9 (x, t, -)aW (t)| (dx) < oo, a.s. Indeed, for any 
n € N, by the definition of A, in (2151), using the Burkholder-Davis-Gundy 
inequality (in Theorem EZT4U), we obtain that 


Padod ieie dm 
(CL ae rave] m e 
<P CEU e S(r, t, t,)dW()|. (ae) > 0}) 
e(t [Lf aste meo], uan > »?}) 
<P({ f ( "dk (dz) > n}) 
M TEN Wt). uda) 
Mitt von Bst) ^ n(dz) > nb) 
E, ([ sea. JBgdt) ^ n(dz) 
e({ f ([ me Nest) " pdx) > nh) 4°. 
Hence, P({ fo | fy l, t, JAW (t)|uu(dz) = oo) = 0. 


By (230) and eds Id (a, t, Zo dt)\/? (dx) < oo, a.s., it is easy to show 


that fo P(x, -,-)w(dx) € T2 Ts £3), 8.8. 
Similar to (2154), one can show that, for any € > 0 and ô > 0, 


«(f f o n(z, t, -JAW (t)u(dz) — -[ fe (x, t, JAW (t) n(dz)|.. > ch) 
(EL 0s (x, t, -))dW( (|. dz) > e}) 
(C. TN Pale gat)" w(de) > 53) +e. 


(2.155) 


(2.154) 





























| à 











| à 


This, together with (Z150), yields that 


P- im f [ a EEE (Duda) -ff a (x,t, -JAW (t)u(dæ). (2.156) 


On the other hand, similarly to (21545), one can show that, 
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«(f n n(x, t, -)u(dz)dW (t f nz (a, t, -)u(dx)dW (t I, > e}) 
= (LP (fe incidun (ax) | (.1.)042))aw o], > eJ) 
m {f | |, (Ent) -= Bet.) n(aa)| dt > 5}) +e 35 
«vU 


This, together with (2.150), yields that 


P- im f [os tacita =f fo (z,t, Ju(dz)dW (t). (2.157) 


Finally, by (2156) and (2157), and noting (2149), we obtain the desired 
equality (2143). o 








IA 














@,,(a,t,-) — O(a, t, jp, dn) "E gta > gay) +e}. 


2.11.4 Itô’s Formula for Itô’s processes in a Weak Form 


Theorem works well for Itó's processes in the (strong) form (2-131). 
However, usually this is too restrictive in the study of stochastic differential 
equations in infinite dimensions. Indeed, in the infinite dimensional setting 
sometimes one has to handle Itó's processes in a weaker form, to be presented 
below. 

Let Y be a Hilbert space such that the embedding Y C H is continuous 
and dense. Denote by V* the dual space of V with respect to the pivot space 
H. Hence, V C H = H* C V*, continuously and densely and 


(4 U)y ye 2 G5 v)g: Vue H, zey. 


We have the following Itó's formula for a weak form of Itó process (Recall 
(E-T32) for the notation ((-,-)) gj). 


Theorem 2.142. Suppose that Xo € L3} (0;H), W(-) is a V-valued, Q- 
Brownian motion (resp. cylindrical Brownian motion), ¢(-) € L2(0, T; V*), 
and B(-) € L&(Q; L?(0, T; L(V; H))) (resp. &(-) € LR(Q; L?(0, T; C9))) for 
some p > 1. Let 


X(t) = Xo + [ o(s)ds + [ sario. t € [0, T]. (2.158) 


If X € L2(0, T; V), then X(-) € C((0, T]; H), a.s., and for any t € [0, T], 


iX (lf = Xol +2 | (d(s), X (s) )y. yds 
(2.159) 


42 | (ts), X (s) ) gdW (s) + | 1(s)Q? gs, a.s. 
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(resp. 


IX (ll = Xol +2 i (4(s),X(8) ye yds 
(2.160) 


aj (8), X) (s) + f I9 (s) [o ds. a.s. ). 


Proof: We only consider the case that W(-) is a V-valued, cylindrical 
Brownian motion. 

Let us introduce the infinitesimal generators of some Cp-semigroups. De- 
note by A the Riesz isometry from Y to Y*, defined by 


(u, Av)y y. = (u, v)y, Yu,v € y. (2.161) 
From (Z161), we deduce that 
(u, Av)g = (u,v)y, Vu,v € Y such that Av € H. (2.162) 


Write D = (v € V | Av € H}. Clearly, A: D(C H) > H is a densely defined, 
closed operator. Also, one can check that A is self-adjoint, and (v, Av), = 
lv|2, for any v € D. Hence, by the Lumer-Phillips theorem, —A generates a 
contractive Co-semigroup on H. Similarly, — A also generates contractive Co- 
semigroups on V and V' (Here, to simplify the notation, we denote by —A 
the “same” infinitesimal generator of three different Co-semigroups). For the 
identity operator I on H (also on V and V") and any A > 0, put I) = A(AI + 
A)~1. It is clear that I, + I strongly on H (also on V and V") as A > +00. 
Write X(C) = DX(-), Xo,X = IyXo, pal) = Del) and Py(-) = I) G@(-). 
Clearly, $)(-) € L2(0, T; H) and @)(-) € LE(£2; L?(0, T; C9)). We claim that 


lim Xo, = Xo in L4 (£2; H), 
A—o00 


Jim éXC) = 6€) in L00, T; V"), (2.163) 
Jim $4(-) = (-) in LE(Q; L? (0, T; £9)). 


Indeed, by A > 0, we see that for any À > 0, |A(A+ A)! [eq € 1. Hence, 
|A(A + A)! Xo — Xo|,, € 2| Xo|g. This, together with Lebesgue's dominated 


PES 

convergence theorem, implies that lim. ,55 IE Auc A) Xo — Xo|*, — 0, which 
gives the first equality in (2163). Similarly, we can prove that the second 
conclusion in (LLIGd) is true. Now, for any A > 0, v € V and K e £$, 
|A(A + A) 1 Kula € |Kv|g. Thus, |A(A + A) 1 K|eo X |K|c9. Therefore, 
|, —P|c9 < 2||;o. Hence, using Lebesgue’s dominated convergence theorem 
again, we obtain the third equality in (Z163). 

It follows from (2:15) that 

















35 oec Xo,a + | “oad ri $.(s)iW(s, te[0T| (2.164) 
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According to (2.163), we get that X4(-) is an Itó process in H. Similar to the 
proof of (2-183), we can show that 


lim X)(-) 2 X() in Z2(0, T; V). (2.165) 


A—oo 


Applying Theorem to X4(-), we find that, for any t € [0, T], a.s 


XDB = oal +2 f. (al) Xal) ve vds 
: (2.166) 


+2 f AOA) 3s6))uaw() + | exis 























By Burkholder-Davis-Gundy's inequality (in Theorem 2140), for any & > 0, 
we see that 
Bcc 2 i 
= sup | f KAA adw] <cB( f gas) 
te[0,T] | Jo 0 z 


ex[ sw Oal floaty)" 


t€[0,T] 














Q 



























































<E sup |X,(t)|? +Se( f lø (s)|? ds) 
E «ejorr] UT" 0 E d 
(2.167) 
Further, 
t D 
E sup J (oals), XA(s)),. pds] < af @y(s)|,,, XA (s), ds 
em | 0 diu E 0 | b (2.168) 


€ laa Olo ryo l XS Clr20,r;v) <C. 


By (Z166)-(ZI68), we find that E sup,ejo,7] | XA (£)|; € C, where the con- 
stant C is independent of A. Hence, there is a if UNAM {An je 2-1 C (0, +00) 
and a X € L2(0;L^*(0,T; H)) such that limpo Xa, = = X weakly star 
in L2(f2; L®(0,T;H)). On the other hand, since X(-) € L2(0,T;V), we 
see that lim, ,4, Xa = X in L2(0,T;V) C L2(0,T;H) Thus, X = X € 
Lig L® (0, TH). 

Letting A — +00 in (2160) and noting (2165), we obtain (Z160). Hence, 
|X (-)|# is continuous. This, together with that X(-) is continuous in Y*, im- 
plies that X(-) is continuous in H. n 














Remark 2.143. When V is only assumed to be a reflexive Banach space such 
that the embedding Y C H is continuous and dense, one can prove a similar 
result as that in Theorem 2.142 provide that there is a Co-semigroup {9 (t) }i>0 
on H such that the restriction of {S(t)}:59 on V is a Co-semigroup on V. 
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2.11.5 Martingale Representation Theorem 


In this subsection, we always assume that F = {F;}+ejo,7) is the natural 
filtration generated by the underlying Brownian motion W(-), which can be 
an R™-valued (for some m € N), or a V-valued, Q-Brownian motion, or a 
V-valued, cylindrical Brownian motion but it can be clarified by the context. 
The goal of this subsection is to prove that any 7 € L*. (Q; H) with mean 0 
can be represented as an Itó integral of a suitable process w.r.t. W(-). 

We begin with some auxiliary results. 


Lemma 2.144. Let W(-) = (W1(),--- ,W,(-)) ! be an R™-valued Brownian 
motion. Then, the following set 


[eam t). --- MA ltn) ; Wti);- ue , Wm(tn)) 0< haec thy T, 
$ € Cg (R""), nen} 


is dense in L7... (Q). 


Proof: Without loss of generality, we only consider the case that m — 1. 
The proof for the general case is similar. 

Let {s;}92, be a dense subset of (0, T] and for each n = 1,2,---, let 
{si}? -1 = = (ti Am —1 with 0 < t4 «--- «t, € T, and F” = c (W (ti), W (t2) = 
W(t4),--- ,W (tn) — W (tn-1)). Then, F” C F"* and Fr is the smallest 
c-algebra containing all of the ¥”’s. Therefore, Fr = o( ULF 


Fix any g € L7. (f2). By Theorem ZY, we have that 


























g =E(g | Fr) = lim E(g| 7"), in L3, (9). (2.169) 


By the Doob-Dynkin lemma (i.e., Theorem ZIJ), for each n, we have that 











E(g | F”) = gn(W (t1), W (t2) - W (t1), +++ , W (tn) — W(ts-1i)) 





for some Borel measurable function gn : R” — R. 

It suffices to prove that there is a sequence of functions {¢,,}?2, C 
Co^ (IR^) such that on, (W (t1), W (t2) — W(ti),--- ,W (tn) — W (tn-1)) > 
gn (W (t1), W (t2) — W (t1), --- , W (tn) — W(tn—1)) in LZ, (02) as k > oo. To 
prove this, we fix an n € N and ane > 0. Write tọ = 0. By 


l9 (W (t1), W (t2) - W (t1), -- , W (tn) — W(55-1))lia. (a) 


22 


~ 204 a 1) 


= Z1,* 5a dz ,---dx < oo, 
h. gin AMO dr (ti — tii) D 


we conclude that there exists a bounded, open subset G C IR" such that 
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z2 
7t — 3-1) 2 
2 € E 
g (z1; T ) —— dri -dEn < —. (2.170) 
TE j n Il 2n(t; = tii) ý 4 


On the other hand, one can find a y € Cg? (G) such that 


‘ uie 2 
[lonten sea) plti, ,z4)] "IL eS dz: dz, < =. 
(2.171) 
From (2170) and (ZIM), we obtain that |g, — Ira. (0) < £. This completes 
the proof of Lemma ZIZA. [1 


Lemma 2.145. Let F : C™ — C be an analytic function. If 
F(zn,:- 2m) =0 
on the set [Gi ,Zm) E C™ | Im z1 = -IM Zm = 0}, then F = 0 in C", 


Proof: For simplicity, we assume that m = 1. The proof for the general | 
is similar. Write z1 = x + iy for x,y € IR, and denote by u and v respectively 
the real and imaginary parts of F. Clearly, both u and v are real analytic 
functions. Since F is analytic, it follows that 


Qu(z, 0) _ Ov(a, 0) E" Ou(x,0)  Ov(r,0) 








=0, VzcR. (2172) 














Óx Oy d Oy | . Ou 
Thus, 
O?u(x,0) 0? v(x, 0) O7u(x,0) v(x, 0) 

= 2 =0 A 1-0, V R. (2.173 

Ox? OyOx i OyOx Ox? p Yee 

From (2172) and (ZTA), we get that 

2 2 2 2 

Ə u(x, 0) = O*v(z, 0) - 0, O*v(z, 0) E O*u(x, 0) zu Me 
Oy? OyOr Oy? OyOx 


Inductively, for any j,k € N, 
O*Fu(x,0)  d3+* u(x, 0) 
OriOy* — AxIOy* 
Therefore, u = v = 0. This completes the proof of Lemma 2.145. L1 





—0,VrcR. 


Lemma 2.146. Let W(-) = (W1(),--- ,Wa(-))! be an R™-valued Brownian 
motion. Then the following set 


X span [ exp { [ h(s)! dW (s) — aa Ih Gli ds | h € L7 (0,7; R”)} 


(2.174) 
is dense in L7... (Q2). 
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Proof: Suppose that g € L7. (2) V {0} is orthogonal (in D. ((2)) to all 


functions in A. For any given ¢1,--- ‚tn € [U, T] with O < tı <---<t, € T, 
we define an analytic function in the complex space C""" as follows: 


F(z) = f emf PY w ti) od? 


i=1 j=1 (2.175) 
Vz-— (z11,77- Xm, ghm nnl ecm. 
For any given A9 € R™,--- , A} € R”, let us choose 
h = M Xp € (0, T; R?). (2.176) 
i=1 


By a suitable choice of (A2, --- , A9) in (ZI), we see that 
FO)- | exp {AT W(t) 4 TW (tn) }gdP = 0 (2.177) 
Q 
for all A = (A1,:-: , A4) with A; € R”,--- ,An € R” and t4,---,t, € [0, T] 
with 0 < tı <---<t, € T. Since F = 0 on R™” and F is analytic, by Lemma 


ZIZ, we conclude that F = 0 in C™”. Particularly, F(iy) = 0 for all y = 
(iis SV Umso Uma) € R"". But then, for any ¢ € Cg? (R7), 


[eto Wa (5), Was (ha). , Wm (tn))gdP 


TL Tri 


= (27 EE (f... oly) exp { 3 iyaW; (ti) bay) gap 

iam (2.178) 
= (27 f 4 »( fom { Y mms (t) bg dP) dy 
=(2n)-™ | d(y)F(iy)dy = 0, 





Rmn 


where $(y) = (2x)-^ fuss O(x)e —iGy)s"^ da is the Fourier transform of ¢. 
By (ZIZA) and Lemma ZIM, g is orthogonal to a dense subset of L7. (2) 
and hence g = 0. Therefore X is dense in L}, (£2). o 


The following result is known as the Martingale Representation Theorem. 


Theorem 2.147. Let W(-) be a V-valued, Q-Brownian motion (resp. cylin- 
drical Brownian motion). If X € L*. (05 H), then there exists one and only 
one F-adapted process ®(-) € L2(0,T; L(V; H)) (resp. &(-) € L2(0, T; £9)) 
such that 














X =EX + [ P(s)dW(s). (2.179) 
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Proof: We only consider the case of cylindrical Brownian motion. We divide 
the proof into three steps. 


Step 1. We consider the case that V = R™, H = R and W(-) is an 
R”™-valued, standard Brownian motion. 


Assume first that X = exp { Joh (s)! dW (s) ae |h(s) (S). ds) for some 
h(-) € L?(0, T; R"). Define 


t 
Y(t) = et f h(s)! aW (s -if |h(s Jis ds). t € [0, T]. 
0 
'Then, by Itó's formula, it follows that 


dY (t) = Y(t) [he aw (t) = TOI + SY (Ih Ol» d 
= Y (t)h(t)  aW(t), 


which gives Y (t) = 1+ i Y (s)h(s) 'dW(s). This leads to 





T. 
x-Y(Dolr f Y (s)h(s)dW (s) 














and EX = 1. Hence, (2179) holds for such kind of X's. 

By the linearity, (217) also holds for any element of A given by (ZIT). 
Now for any X € Lá. (£2), by Lemma LIZ, we may approximate it in L5. (2) 
by a sequence {Xn}; C X. Then for each n € N, we have 














T 
X,-EX,* | SG) dW(s), for some &, € L3(0,7;R"). 
0 


By the third conclusion in Theorem ZIZA, for any k € N, 





























E(Xn — a = E[E(X, = AR) + [ 9. = $,)(5) aW (s)| Í 


T 
=E - XP f E 
0 


as k,n — oo. Hence, (9,99 , is a Cauchy sequence in L2(0, T; IR") and hence 
it converges to some 9 € L2(0, T; IR"). Hence, 


























ds — 0, 














X= lim Xn = lim 


n> n— oo 




















P MES ri T nls) dii) =EX+ f " &(s) dW(s), 
0 0 


— 


the limit being taken in L7. (QQ). Hence the representation (ZI79) holds for 
all X € LZ, (Q). The uniqueness of is obvious. 
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Step 2. In this step, we consider the case that H = R and W(-) is a V- 
valued, cylindrical Brownian motion. By Definition ZIZO, W (-) can be formal- 
ly written as W(-) = 357-4 wi(-)ei, where (w;(-) 24 is a sequence of indepen- 
dent real valued, standard Brownian motions, and {e;}%2, is an orthonormal 
basis of V. 

Clearly, /? can be regarded as a subspace of L2(V;R) = L(V; R). Indeed, 
for any a = (a41,a5,:--) € £, it can be defined as an element of £2(V;R) by 
alv) = 57-4 aivi for any v = 35.4 Viei. 

For each k € N, denoted by {F} .ejo,rj the natural filtration generated 
by (wi()) t4. For any X € L}, (Q), similarly to (E-IGJ), there exists an 
Xy € Lx (2) such that 


jim X,— X in L*..(2). (2.180) 
—oo 


For every k € N, by Step 1, there is a 9, € L2(0, T;IRF) c L2(0,T; 0) c 
L£(0,T'; £2(V;R)) such that 


























T T 
Xe =EXp + f eG dw()- EX + | euo) (2181) 
0 0 


In the last term of the equality (Z181), we have regarded ®;(-) as an element 
of L2(0, T; C3(V; R)). From (ZIRI), using the conclusion 4) in Theorem 2133, 
we find that, for any k,n € N, 














T 2 
[Pr — 9l 2t rico) = z| f (Pe(s) — Pa (s))dW (s) 
T ? (2.182) 








= F 











Xp — Xal’. 

















! "ét dW(s) — [ save «s 


0 


This, together with (LLTNU), indicates that ($5) ;? , is a Cauchy sequence in 
L£(0, T; C3(V; R)). Denote by the limit of (9,28 ,. Then, 














T 
X = lim Xy, = lim ex. f ,(s)dW(s)| 
k—oo k—oo 0 














T 
-EX4 f B(s)dW(s) i L3, (9). 


Step 3. In this step, we consider the general separable Hilbert space H. 
Let (h;)j9. be an orthogonal normal basis of H. Then, (X, hj} a € L5, (2) 
for j € N. Thus, we can find a ¢; € L2(0, T; C3(V; R)) such that 














T 
(X, hj) H = E(X, hj) H +f $; (s)aW (s). (2.183) 


Similar to (218), it holds that 
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saw s) < E|(X, hj) al’. (2.184) 














" " 
ISslz2(0,7;£2(V:R)) =" 


Therefore, 














oo T 
X- x«l ó;(s)dW (s)h;. (2.185) 
j= v9 


Hence, we only need to prove that there is a  € L2(0, T; £3) such that 


T oo T 
| sme =>) f ó(s)dW (s)h;. (2.186) 


First, by (2184), we have that 






































2 29 T 
sawn, =DE [ejas de <ER 





Let us define &(-) by &(-)u = »»C )h; for any v € V. Then, 














































































































j=l 
T oo oo 2 
2 7 
POr = Ef L| Ltrs] a 
i= j= 
T 99 oo oo 
" J SV I(o;e:) [eat = 2766 dbaor < +00, 
j—1i-1 
and the equality (2186) holds. This completes the proof of Theorem 2.147. 
LI 
Remark 2.148. By (E-LT9), it is easy to see that 
t 
E(X | F) = EX + ri &(s)dW (s) (2.187) 
0 
and 
Ed 1 
E|X — EX|2, = e| |P(s)Q? |Zods (2.188) 
0 
(resp. 
T 
HX- EX} = J |(s)[20ds ). (2.189) 
0 





As a consequence of Theorem 2.147, we have the following result, which 
will play a crucial role in the study of backward stochastic evolution equations. 
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Corollary 2.149. Let W(-) be a V -valued, Q-Brownian motion (resp. cylin- 
drical Brownian motion). Then, for any f € L1(0, T; L?(Q; H)), there is a u- 
nique K(-,-,-) € L+ (0, T; L2(0, T; L(V; H))) (resp. K(-,-,-) € L+(0, T; L2(0, T; 
£9)) satisfying the following conditions: 

1) K(s,0,-) =0 fora > s; 

2) For a.e. s € [0,T], 














f(s) 2 Ef(s) + L K(s,o)dW (o), a.s.; (2.190) 


|K Css) es 0,T;L20,T;£(V;:H))) S |F ILLO,T; L22; (2.191) 
(resp. |K(-,-,-)|z1(0,7;12(0,7;£3)) € | flz4(0,7;22(2;4)))- 


Proof: We only consider the case that W(-) is a cylindrical Brownian mo- 
tion here. For f € L#(0,7; L? (Q; H)), we can find a sequence { fn}; of sim- 
ple processes such that f; tends to f in L1(0, T; L?(; H)) as n — oo, where 
fr(s,w) = pes X [tn avtni41)(8)En,i(w) for some partition {tp,0,tn,1,°°> tn,n} 
of [0, T] and ĉn; € L (ŒH). 

By Theorem UIT and Remark ZI | for every Eng; there is a kng € 
L2(0, T; C9) such that 














ini 
Ermi = ER Eni +f kn i(0)dW (o), kin i (a) =0 for o> tn is (2.192) 
0 


Put Kn(s, c) - x Min eda vay S08] (a)kni(o). Then, 














fals) =Efn(s) + i K,(s, c)dW (c). (2.193) 


From (2193), we see that, for any n, k € N, 


T 














"(s [ (5,0) — Ky(s, e) do)" ds 








1/2 
2 [ \Ba(s,0) — Kals, else) ds 


(2.194) 








uf. K,(s,c)dW (o -f K,(s,0)dW(o [as 


) "as 









































[i 
| ( 
fe 





(3) = f(s) — (Ef«(s) - EC) 


H 
< |fn — fk|ritor.z2(02)- 


Since (f, €, is a Cauchy sequence in L1(0, T; L?(Q; H)), by (2194), we find 
that {Kn ye. is a Cauchy sequence in L(0, T; L2(0,T; £9)). Thus, there is a 
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K e L'(0,T. E2(0, T; £9)) ao that limpo Kn = K in £'(0, T; L2(0, T; £8). 
This, together with (2193), implies (Z190). 
Similar to (ZI), one has 














T T' 1/2 
| (f LG. (s, o) [23de') ds < |f ri (oT L2 (02) (2.195) 
0 0 


Taking n — oo in (2195), we obtain (219M). o 


2.12 Notes and Comments 


Stochastic Analysis is a huge subject which is still growing up and flourishing. 
In this chapter, we only present a brief introduction to the relevant results will 
be used in the rest of the book, and we omit the proofs of some classical results, 
which can be found in almost all standard books (e.g., |54, L64, 287]). Interest- 
ed readers can find more materials in the references such as [b8, 68, 129, 140]. 
Theorem [255 was proved in [239]. Section ZH was based on [242]. The proof 
of Theorem 2.140 (Burkholder-Davis-Gundy inequality) can be found in [68], 
for example. Note that the inverse inequality of (2137) (resp. (2138)) in 
Theorem ZIZ is also true, i.e., one can prove that 


Gan [rm 2 wot) 


2 
2 








Xj 




















(resp. 


























e( ( su |S 10 s)dW(s P= eC rhe)». 


but we will not use it in this book. The readers are referred to [B27] and 

the references therein for the general stochastic Fubini theorem. The proof 

of Theorem can be found in [282, 286]. In this book, we present an 

elementary but long proof of the Martingale Representation Theorem (There 

exist some shorter proofs which need more preliminaries on stochastic analysis, 
g., 0, IL75]). 

In this book, we use the Itó integral, which is the most common and 
useful way to define stochastic integral w.r.t. a Brownian motion. There are 
two other typical ways to define stochastic integral: Stratonovich integral (e.g., 
[L56]) and rough path integral (e.g., [[03, Z50]). Stochastic integral (including 
multiple stochastic integral) w.r.t. more general stochastic processes can be 


found in [I29, II78, [182]. 


®) | 
^ f | 
Check for | 
updates 
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Stochastic Evolution Equations 


'This book is mainly addressed to studying the control problems governed 
by stochastic evolution equations. In this chapter, we shall present a short 
introduction to the well-posedness and regularity of solutions to this sort of 
equations, valued in Hilbert spaces. 

Throughout this chapter, T > 0, (2, .F, F,PP) (with F = (J)epo,r]) is a 
fixed filtered probability space satisfying the usual condition, and we denote 
by F the progressive c-field w.r.t. F; H and V are two separable Hilbert 


spaces; we denote by J the identity operator on H, and write £9 E! Lo(V; H). 


3.1 Stochastic Evolution Equations in Finite Dimensions 


In this section, we shall consider the well-posedness of stochastic evolution 
equations in finite dimensions, i.e., stochastic (ordinary) differential equations. 

Fix d,n € N and p > 1. Let W(-) = (W!(),---,W?())! be an d- 
dimensional standard Brownian motion. We consider the following stochastic 
differential equation: 


| dX(t) = F(t, X)dt + F(t,X)dW(t) in [0, T], m 


X(0) = Xo. 


In (ET), X is an unknown, and the initial datum Xo is a given Fo-measurable 
R^-valued function; F(.,-,-) : [0, T] x 2 x R” + R” and F(.,-,-) : [0, T] x 
N x R?” > R”*4 are two given functions. Here and in what follows, when the 
context is clear, we omit the w(€ (2) argument in the defined functions. In 
the sequel, we call F(t, X)dt and F(t, X)dW (t) the drift and diffusion terms 
of (ELI), respectively. 

To begin with, as for ordinal differential equations, one needs to define the 
solution to (Bl). The following is the most natural one. 
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Definition 3.1. An R"-valued, F-adapted, continuous process X(-) is called 


a solution to (ET) if F(-, X(-)) € D (0, T; R?) a.s., F(,X()) € D2""*(0,T; 
R"*4), and for each t € [0, T], 


X() - Xv» | F(s, X(9)ds- | F(s,X(s))dW(s), a.s. (3.2) 


The solution to (B) is said to be unique, if for any other solution Y (-) to 
(ECT), one has P({X(t) = Y (t), t € (0, T])) 2 1. 

In the rest of this section, we assume that 

1) Both F(:, z) and F(-, x) are F-adapted for each x € R”; and 

2) F(-,0) € LE(Q2; L! (0, T; R”)) and F(-,0) € LA(Q; L? (D, T; R”*4)), and 
there exist two nonnegative functions L4(-) € L!(0,T) and Lo(-) € L?(0, T) 
such that for any z, y € R” and a.e. t € [0, T], 


l |F (t, a) — F(t, y)lre < Li(t)|a — vulgo; 


m xs a.s. 
|F (t, 2) — F(t, y)|lraxa < Lo(t)|a — yir», 


The fundamental existence and uniqueness result for the equation (BI) is 
as follows. 


Theorem 3.2. For any Xo € Lf (2; R"), the equation (ZJ) admits a unique 
solution X(-) € LE (0; C([0, T]; R”)) satisfying 


IX C)Izgcoseqorygm)) S C(IXolzs. (oae) + IEC 0) re coii or) inh 


+|F(-, O)| Le (2;L2(0,T;R”x4)))- 


Moreover, if Xo € LE. (2; R") is another initial datum and 356) is the corre- 
sponding solution to (E), then 


IX C) = X C) zecaccomiio S CIXo — Xolzz, (2r): (3.4) 


Proof: For any T, € (0, T) and z(-) € L(2; C([0, T1]; R")), we define 


t 


J (x(-))(t) = x | F(s,x(s))ds + f F(s,a(s))dW(s), t€ [0,Ti]. (3.5) 


By Holder’s inequality, it follows that 









































t 
p 
E sup J Fsstnas 
O<t<T; ' JO R”? 
t p t p 
<¢(E sup ] Foods +E sup [ setenta") (3.6) 
OXt«TY | JO R” O<t<T, ' JO 























Ty p . 
«e[s( f IF (s leds) Ol oa TO gcseqnae) 
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where C is independent of Tı. Similarly, by the Burkholder-Davis-Gundy in- 
equality (i.e., Theorem 2140), we have 


Ti /2 
«ex( | |s, 2(8))|nxads) 


( | "Fs, 0). ads) a | 


< c|e( f “Mao Plel)kas) e | i (5 0)laxads)" 


p p 7 Tox 2 p/2 
S C [rs Offsq sol Oasa +E (f IF(s. 0) ads) | 




















E sup 
0<t<T; 


< e[s( [ Fenton — F(s,0)[axads) a 








f F(s,x(s))dW(s) 








p 
Ra 








A 















































(3.7) 
Hence, by (EZ3)- (EL7), we arrive at 
E sup |J(x()(t)les 
0ctzTy 
<C ( Li (ltron) + itat kaana) Ix ()l e (o.c; 18) (3.8) 





























+E 














Ti p Ti. a p/2 
Xolka+e( f LF(s,0)|ands) «(f LF (s, 0). ds) | 
0 0 


By (BB), it is easy to see that J'(x(-)) € Lz(£2; C([0, Tı]; IR")). Further, 
from the proof of (EN), we see that 


IJ (2) — J (v C))Izgco:eqo.r se» 


(3.9) 
< C (Va Cs tojm) + ILoC)lz2(;) Iz(-) — v C)Irzcose(to m]: 


for any z(-),y(-) € DE(£2; C([0, T1]; R")). We choose a T; € (0, T) such that 


chI Cito; + ILaC)lz2(o;.)) <1. (3.10) 


By (E9), the map J : L£(02; C([0, T1]; R”)) > LR(2; C([0, T1]; R”)) is con- 
tractive. Thus, J admits a unique fixed point, which gives a solution X (-) to 
(ET) on [0, 71]. Further, by (ELS) and noting (ELIU), we see that X(-) satisfies 
the estimate (ZA) with T replaced by T1. Repeating this procedure, we obtain 
a solution X(-) to (ELT) on [0, T] and it satisfies (3). The other conclusions 
in Theorem follow also from the above argument. LI 


Now, we consider the following linear equation: 


d 
dX(t) = (A(t)X(t) + f(t))dt + 2 (C;(t) X (t) + gi(t))dW'(t) in [s, T], 


X(s) — €. 
(3.11) 
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Here s € [0, T), € € L4 (0; R"), and 
A(-) eri T; LO (2; R?*”)), Ci() € LZ(0, T; L® (2; gy. Gum 
FC) € (0; L(0,T;R*), gif) € L2(0,T; R”). l 


In the rest of this section, we shall derive a representation formula for 
solutions to the equation (ETT). For this purpose, let us consider the following 
two (R"*"-valued) stochastic differential equations: 


d®(t) = t)dt + yaw t)dW(t) in [s, T], ius 
$(0) = Is, 
and 
d d 
dV(t) = w(t)( — A(t) + M 5 Ci(t)?)dt — S ^w(t)C;(t)aW'(t) in [s T] 
v (0) = In, 
(3.14) 
where In is the identity matrix in IR"*". By Itó's formula, we have that 
d(w(t)®(t)) 
= dW(t)®(t) + V (t)dd(t) + dv (t)d®(t) 
d d 
= —Y(t)A(t)G(t)dt + W(t) V ^ C; (t)?(t)dt — V ^ w(t)Ci(t)8(t)aW'(t) 





d d 
V (t) A(t)8(t)dt + V ^ w(t)C;(t)8(0)aW'(t) — W(t) X C; (0)? 9(t)dt 


=0. 


This, together with v(0)9(0) = In implies that V(-)9(-) = I, in [0, T]. Hence, 
W(t) = ó(t) ! for all t € (0, T]. We have the following variation of constants 
formula for solutions to (B=). 


Theorem 3.3. Let the assumption (ZTA) hold. Then, for any € € L5 (2; R"), 
the equation (BII) admits a unique solution X(-), which can be represented 
by the following formula: 


XO = e +40) | 9m" 00 - Y, 6ao)dr 
= (3.15) 
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Proof: Write 


vi) - e f oe (no- Ye Dur Jay «o (r)aw'(r). 


S 


By (6-13) and Itó's formula, it follows that 


(PEY (t)) = (A(0)9(t)Y (t) ))dt + Y Y (t) + gi(t)) aW" (t). 


Also, 8(0)Y (0) = £. By the uniqueness of solutions to the equation (B), we 
conclude that X(t) = &(t)Y (t), which gives the desired result. Oo 


Remark 3.4. As we shall see later (in Theorem EZO), the conditions A(-) € 
Li(0, T; L©(Q;R"*")) and C;(-) € L2(0, T; L® (2; R^*")) in (ELT2) (for The- 
orem EA) can be weakened as A(-) € Lg?(£2; L1 (0, T; IR"*?)) and C;(-) € 
LE (N; L? (0, T; R?*")), respectively. 














3.2 Well-Posedness of Stochastic Evolution Equations 


In the rest of this chapter, W(-) may be a V-valued, Q-Brownian motion 
or cylindrical Brownian motion but we only consider the case of cylindrical 
Brownian motion. 

We consider the following stochastic evolution equation: 


d = (AX(t)+ F(t, X(t)))dt + F(t, X(t))dW(t) in (0,7), (sie 


3600) = Xo. 


Here Xo : 22 — H is an Fo-random variable, A generates a Co-semigroup 
{S(t)}is0 on H, and F(-,-): [0,T] x x H 2 H and F(.,-): [T] x 2 x 
H — L$ are two given functions. Similarly to the case of finite dimensions, 
in the sequel, we call (AX (t) + F(t, X (t))) dt and F(t, X)dW (t) the drift and 
diffusion terms of (E. TG), respectively. 

It is easy to show the following result (and hence we omit the details). 


Proposition 3.5. For any g € proe T; £9), the H-valued, stochastic pro- 
cess fi S(- — s)g(s)dW (s) has a continuous modificatiorll. 


3.2.1 Notions of Solutions 


Similar to the case of deterministic evolution equations, one has several ways 
to define solutions to (B10). The most natural way seems to be the following 
one. 


1 In the sequel, we shall always use such a modification for f; S(- — s)g(s)dW (s). 
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Definition 3.6. An H valued, F-adapted, continuous stochastic process X(-) 
is called a strong solution to (BI) if 
1) X(t) € D(A) for ae. (t,w) € [0, T] x 2 and AX(-) € L1(0, T; H) a.s.; 


2) F(-, X()) € D3(0,T; H) a.s., F(, X(-)) e L? (0, T; £9); and 
3) For all t € [0, T], 


X(t) = Xo +f (AX(s) + F(s, X(s)))ds +f F(s,X(s))dW(s), as. 


Example 3.7. Let V = R, {T (t) }>0 be another Co-semigroups on H with the 
infinitesimal generator B so that D(A) C D(B?) and S(-)T(-) = T(-)S(-) 
(Particularly, we may take B = I). Then, by Itó's formula, a strong solution 
to the following equation 


dX(t) = AX (t)dt + 5 BPX (tdt + BX(t)dW _ in [0,00), 
X(0) = Xo € D(A), 
is given by X(t) = S(t) (T(W (1)) Xo). 


Unfortunately, generally the conditions which guarantee the well-posedness 
of (816) in the sense of Definition EH are very restrictive. Therefore, following 
the idea of weak and mild solutions to deterministic evolution equations, peo- 
ple also introduce similar notions for its stochastic counterpart (Recall (2.132) 
for the notation ((-, -)) y). 


Definition 3.8. An H -valued, F-adapted, continuous stochastic process X(-) 
is called a weak solution to (STO) if F(^, X(-)) € L1(0, T; H) a.s., F(,X()) € 
L?/**(0, T; £9), and for any t € [0,T] and £ € D(A*), 


CEDE oes Og Es +f ((X (s), A*E) y + (F(s, X(s)), €) ,)ds 
(3.17) 


+ f (FexGye)udwG). as: 
0 


Definition 3.9. An H -valued, F-adapted, continuous stochastic process X (-) 
is called a mild solution to (IQ) if F(-, X(-)) € D1(0,T; H) a.s., F(,X()) € 
LE S T; £9), and for any t € [0, T], 


X(t) = S(t)Xo + n S(t — s)F(s, X(s))ds 
; " (3.18) 
4 | S(t — s)F(s,X(s))dW(s), a.s. 
0 
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It is easy to see that, if an H-valued, F-adapted, continuous stochastic 
process X(-) is a strong solution to (ELTG), then it is also a weak solution to 
the same equation. The following result shows the equivalence between weak 
and mild solutions to (EIU). 


Theorem 3.10. An H-valued, F-adapted, continuous stochastic process X (-) 
is a weak solution to (BTO) if and only if it is a mild solution to the same 
equation. 


Proof: The “only if? part. Since X(-) is a weak solution to (ELTG), for 
any fixed ó € D((A*)?), t € (0, T] and r € [t, T], we choose £ = S*(r — t) A*ó 
in (2172), and obtain that 


(X(t), S*(r — t)A* P) y 


- QS" - 0479), f (X (s), A*S* (r — t) A* à) yds 


(3.19) 
+ [ (FOXO) SE- 0470), 





+ l (F(s, X(8)), S*(r — 2)4*6) 4W(s). 


Integrating (ELT9) w.r.t. t from 0 to r, we obtain that 
^ (X (t), S*(r — t) 4*9) ydt 
0 
= A (Xo, S*(r — t) A* à) , dt ets f [ox ), A* S* (r — t) A* à) „dsdt 
0 


m i. fe )), S*(r — t) 4* o) ydsdt 





+ a [4& )), S* (r — t) A*@)) dW (s)dt 
(3.20) 
A direct computation shows that 
Xo, S*(r — t)A* dt — AS(r — t) Xo, dt 
i ope Quan. | AEE tud, (3.21) 


= (S(r) Xo, 9) y — (Xo. $) y 


By Fubini's theorem (i.e., Theorem ZZD), we find that 
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a [ox *(r — t)A*à) , dadt 
E [A f (X (s), A*S*(r — t) A* d) „dtds (3.22) 
= [ (X(s), S*(r — s)A* à) yds — [ (X (s), A* 0) yds 


[f[« S" (r — t) A* o) ,,dsdt 


Er (F(s, X(s)),S* caf (F(s, X (s)), 9) yds. 
0 0 


and 
(3.23) 


By the stochastic Fubini theorem (i.e., Theorem 2141), we see that 


MRG S*(r — t) 4*9)  dW (s)dt 


=[ fe S*(r — t)A* à) gdtdW (s) 
" [ (F(s, X(s)), 8*(r — s)6) ydW(s) — ri " (Fs, X (3), 6) ga (s) 


=( | se - FG xen o), - | (PG xe» 6) xa). 
(3.24) 
From (ELZU)-(ELZ4) and using (ELTZ) again, we end up with 


(xt) = s) - | Str - FG X(s))as 
; : (3.25) 
=f S(r — s)F(s, X (s))dW (s), 6). =0. 
Since D((A*)?) is dense in H, (@25) also holds for any ¢ € H, which indicates 
that X(-) is a mild solution to (#10). 


The *if" part. Assume that X(-) is a mild solution to (218). Then for 
any € € D(A*) and r € [0, T], we have that 


(X(r) - $0)X, - | " S(r — s)F(s, X(s))ds 
: Š (3.26) 
x S(r — s)F(s, X (s))dW (s), Ate) =0. 


Fix t € [0, T]. Integrating (2-26) from 0 to t w.r.t. r, we find that 
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fos, 
-[ (S(r)Xo, A*E) ork nc (r— s)F(s, X(s)), A*£),dsdr (3.27) 


+f [ «5 (r — 5)F(s, X(s)), A*€) ydW (s)dr. 


Clearly, à 
f (S(r)Xo, A*£) ydr = (S(t) Xo, €) y — (Mint) P (3.28) 


By Fubini's theorem, we find that 
ra nc (r — s)F(s, X(s), A oe dsdr 
= f rà (AS(r — s)F(s, X (s)), £) ,drds (3.29) 
0 vs 


EJ (St 9)P(s X(9)6) ds - f (F(s, X (s), £) , ds. 
0 0 


'Thanks to the stochastic Fubini theorem, we see that 


[ [ «5 (r — s)F(s, X (s), A*E) „dW (s)dr 


- ra f Q AS(r — s)F(s, X (s)),£)) gdrdW (s) 


z f (S(t — s)F(s, X(s)), £) gdW(s) — f (Ps, X(8)), €} ydW(s). 


(3.30) 
From (EZ7)-(E.3U) and noting (BZA), we see that X(-) satisfies (ELT). Hence, 
X(-) is a weak solution to (2-16). O 


The following result provides a sufficient condition for a mild solution to 
be a strong solution to (B10). 


Lemma 3.11. A mild solution X(-) to (ETA) is a strong solution (to the same 
equation) if the following three conditions hold for alla € H andÜü st 
T, a.s., 

1) Xo € D(A), S(t—s)F(s,x) € D(A) and S(t—s)F(s,x) € £3(V; D(A)); 

2) | AS(t—s)F(s, x)|g € a(t—s)|x|g for some real-valued stochastic process 
a(-) with a(-) € L*(0,T) a.s.; and 

3) |AS(t — s)F(s,v)|eo < B(t — s)|x|u for some real-valued stochastic 
process B(-) € L2/^*(0, T). 
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Proof: Since X(-) is an H-valued, continuous stochastic process, by the 
conditions in Lemma E, we have 


f [i |AS(t — r)F(r, X (r))| , drdt «00, as. 
o Jo 


and us 
I J Aste) BO. XC))lžgdrdt < 00, a.s. 
o Jo 2 


By Fubini's theorem, we have 
t ps t pt 
f f AS(s — r)F(r, X(r))drds = n / AS(s — r)F(r, X (r))dsdr 
o Jo 0 Jr 


x sq - r)Fi Xt)ar - | F(r, X (r))dr. 
0 0 


On the other hand, by Theorem ZIM, we have that 
t ps t pt 
n ri AS(s — r)F(r, X (r))dW (r)ds = f n AS(s — r)F(r, X (r))dsdW (r) 
o Jo 0 Jr 


= st - nF, xe)awt) - f F(r, X (r))dW (r). 
0 0 


Therefore, by (218), AX(-) is integrable a.s. and 


t 


f AX (s)ds = S(t)Xo — Xo «f S(t — r)F(r, X(r))dr — f F(r, X(r))dr 
0 0 0 
+f S(t — r)F(r, X(r))dW (r) — f F(r, X(r))dW (r) 


t t 
= X(t) — Xo— | F(r, X(r))dr — f F(r, X (r))dW (r). 
0 0 
This indicated that X(-) is a strong solution to (ELTG). o 


3.2.2 Well-Posedness in the Sense of Mild Solution 


In the rest of this section, we will focus on the well-posedness of stochastic 
evolution equations in the sense of mild solution. 

Let us begin with the following result, which is an easy consequence of the 
Burkholder-Davis-Gundy inequality (in Theorem Z-TAU). 


Proposition 3.12. For any p > 1, there exists a constant Cp > 0 such that 
for any g € Le(£2; L?(0, T; C9)) and t € [0, T], 











"y 

















[ st Saa, <e, fitis). ea 





3.2 Well-Posedness of Stochastic Evolution Equations 141 
We consider first the following linear equation: 


l dX(t) = (AX (t) + AX (t) + f(t))dt + (BX (t) + g(t))dW(t) in (0, T], 


X(0) = Xo. 
(3.32) 
Here Xo, A, B, f(-) and g(-) are suitable vector/operator valued functions 
to be given later. We have the following well-posedness result for (E32) with 
A — 0 and B — 0. 


Theorem 3.13. Let Xo € L'- (0; H) for some p > 1, A=0, B=0, f() € 
LE(0; L' (0, T; H)) and g(-) € L?(Q; L(0,T; C9)). Then, the equation (E32) 
admits a unique mild solution X(-) € Cr([0, T]; L (2; H)). Moreover, 


X )losqo.T]z»(0:2) (3.33) 
f , 


< (lXolz2 (9:1) + MIzzcoizi ori) + lIle (2;12(0,T;£9)))- 


Proof: Clearly, 


X(t) = S(t)Xo + f S(t — s) f (s)ds +f S(t — s)g(s)dW(s) (3.34) 


is a mild solution to (E32). Now, we prove that X(-) € Ce([0, T]; L?(Q; H)). 
First, by Proposition ELT2, for any t € [0, T], 


|X (t) lez, (Q;H) 


= [sv « | st - 2f) 4 | S(t — s)g(s)dW (s) 


L5. (0H) 





& SO Xol;s oun * d S(t — s)f (s)ds (3.35) 


LE. (9H) 


+| a S(t — s)g(s)dW (s) 





LE (03H) 
< C(IXolzz. (axe) + |f|z2(09;11(0,4;4)) + gl rz (9:2 (0,569)))- 


Hence, 


X (-)| L (0,7;L°(2;H)) 
(3.36) 
< C(IXolzz. (a) + |f|zecoizi(o mu) + gre (0:12 (0,7;c9)))- 


Obvious, S(-) Xo + f, S(- — s)f(s)ds € Ce([0, T]; LP (2; H)). It remains to 
show that fj, S(- — s)g(s)aW (s) € Ce([0, T]; L?(Q; H)). For this purpose, for 
any tı and tg satisfying 0 < tı < t9 < T, we have 
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(t2 — s)g(s)dW (s j- [^ st - 9 s)dW (s) 














Ly, (iH) 
ife Ld to 
ty — t2—tı)— 1I . 
4f S(t — s)[S(ta — t1) — I]g(s)aW (s) LE, (H) 


By Proposition BIZ, it follows that 


n S(t — s)g(s)dW (s) 





< C|g| L2 (0,12 (t1,t2;£9))- 


L5, (5H) 


Since Je lg(s) 7, d5 < SE] 19 d5, by Lebesgue's dominated convergence 
theorem, we find that 


lim Hs S(ta — s)g(s)dW (s) 




















tioty Ly, (85H) 
(3.37) 
t2 á 2 i 
<C lim |E | s)\2ods) |" —0. 
<c tim [EC J la(s)l2yds) | 
Likewise, 
ty 
im | f SG; — s) [So — t1) — TlatodWs —0. (3.38 
Se AA (t — s)[S(t2 — t1) — I] 9(s) lee (at (3.38) 


By (B34 and (EL37)- (E33), we conclude that lim, ,,- IX (t) - X(to)lre. (2:4) 
t2 

tg |X (t ) = X (to)lzz, , C2 = 0. By 

(2.30), we obtain (2.33). This completes the proof of hearen Et] Oo 


= 0 for any to € [0,T]. Similarly, lim 


In the sequel, we need the following assumption on the nonlinearities in 


(5-10). 


Condition 3.1 F(.,-): [,T]x Qx H 2 H and F(.,-): [0,T]xQxH > £9 
are two given functions satisfying 

1) Both F(-,x) and F(:,x) are F-adapted for each x € H; and 

2) There exist two nonnegative (real-valued) functions L1(-) € L'(0,T) 
and Lo(-) € L?(0, T) such that, for any x,y € H and a.e. t € [0, T], 


l |F, x) — F(t,y)la S Li(é)|a — yla, 


" E a.s. (3.39) 
|F (t,£) — F(t, y)leg € Lo(t)|e — yla, 


We have the following well-posedness result for (#10). 
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Theorem 3.14. Let Condition EL hold, and F(-,0) € L5(€2; L! (0, T; H)) and 
F(-,0) € LE(Q;L?(0,T;L3)) for some p > 2. Then, for any Xo € L5 (8; H), 
the equation (BIO) admits a unique mild solution X(-) € Cg([0, T]; L” (Q; H)). 
Moreover, 


IX (-) lc«(0, T]; Lo (2;H)) 
" (3.40) 
<C(|Xolzz, (amy tlF(-; 0) re coins o ry VF Cs 0) reco 2 (o,7.c9)- 


Proof: Fix any T, € (0, T]. For any Y € Cz([0, T1]; LP (Q; H)), we consider 
the following equation 


l dX(t) = (AX (t) + F(t, Y (0))dt + F(t, Y ())dW(t) — in (0, T4], (dh 


X = Xo. 


By Condition B and noting L(0, T1; LP (Q; H)) C L£(Q; L! (0, Ti; H)), we 
see that 


IFC Y C)lzzco;ni (o, i) 
€ |F(50)l reor: + MA C)IY Ola lzor) (3.42) 


SFC, O)[z2(0;11(0,71;£9)) + Calero lY (lee (o,71:0? (2:8): 





Using Condition BJ again and noting p > 2 (and hence L2(0, T1; L? (Q; C9)) 
C L£(Q; L?(0, T1; C2)), we see that 


IFC, Y C)lzeco;z2(o,r c2) 
< |F(0)|re(oiz2(0,7c9) + CIL2C)0Y C) rl za (oim zo c) (PA 





< |F(-O)rz(o;r2(01.c9) + ClE2)|zz(o mol Y (lcron) 


By (E.22)- (8.43) and Theorem BIJ, the equation (BÆ) admits a unique mild 
solution X(-) € Cg([0, T1]; LP (2; H)). We define a map J : Cr([0, Ti]; LP (Q; 
H)) > Cp([0, 71]; LP (2; H)) by J(Y) = X. 

Now we show that the map J is contractive provided that T; is small 
enough. Indeed, for another Y € C([0, T1]; LP (Q; H)), we define X = J (Y). 
Write X() = X()— XC), AC) = F(Y() — FGYC) and &() = 
F(,Y(-)) — F(-, Y(-)). Clearly, X(-) solves the following equation 


dX(t) = (AX (t) + Fi (£))dt + F(04W(t) — in (0,11], (3.44) 


X(0) — 0. 
Similar to (ELT2)-(ELT3), we have 


IF (lrer (o7) S CHA om)lY C) — YClostoriscom (3-45) 
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and 

IF C) Drecosz2 (or c9) SC C) Dato; JY C) Y Oloo, T] (3.46) 
Applying Theorem to (44) and noting (E-Z3)-(E-40), we find that 


|X C)lesqo/n Ez» (2:H) 
€ C(IFAC)lzecoiz3 (0,7 0) + Fi) 22 (2;12(0,71;:£9))) 
€ C(L Olon) + HD2C)6z2t,m))lY C) — Y Olesqo;rzoco:2)- 


Choose T; so that C(|L1(-)|z2(0,7,) + |[L2(-)|z2(0,7,)) < 1. Then, J is contrac- 
tive. By means of the Banach fixed point theorem, J enjoys a unique fixed 
point X(-) € Cr([0, T1]; LP (2; H)). It is clear that X(-) is a mild solution to 
the following equation: 


l dX(t) = (AX (t) + F(t, X(t))dt + F(t, X(t))dW(t) in (0, T1], mus 


X(0) = Xo. 
By (E22)-(ET3), we see that F(-, X(-)) € LE(2; L1 (0, Ti; H)), F(, X()) € 
LA (Q; L? (0, Ti; £9)), and 
IFC, XC) recor (omm) + IF X C)czgcosz2to c2) 
< |F(-0)|re(o;zi(o,r, 8) + IF (0) | reo;r2 (7.69) 
*C(IaC)lzi om) + H2 C)Lx2(om))0HX C)lesttoir)zoco2)- 
Therefore, using Theorem again, we find that 
IX CJlos(o;m)zo (0:8) 
< c(Ixol ne, cont VG X C) eges oom n) + EFC, X ODlgcszotorm.icty) 
<c|ix ol Le, (Qe) + |F (-, 0)|z2(.0;2300,71;H)) + IEC, O)| rz (2;L2(0,T,;£9)) 
( 


(La Olzstoon) Lohnt») X Olerco.riisee cout): 
(3.48) 
Since C(|L1(-)|z1(0,7,) + |Z2(-)|z2(0,74,)) < 1, it follows from (E38) that 


IXOlc 

([0,71]; LP (2;H)) 
ORE - (3.49) 
EC(IXolzz. (ont FC; O)| r2 (2:11 0,7 myt VF C: 0) ze (0:12 (071:c9))- 


Repeating the above argument, we obtain a mild solution to the equation 

(ELTG). The uniqueness of such solution to (BIA) is obvious. The desired esti- 

mate (840) follows from (849). This completes the proof of Theorem BTA. 
O 
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Remark 3.15. In the above proof (of Theorem BIA), p > 2 is a key assumption. 
Otherwise, we cannot show that 


F(-,X(-)) €LRQ;DL(0,T;09)), | v XC) € Ce([0, T]; L?(@; H)). 


As far as we know, it is an unsolved problem to establish the well-posedness 
result (as that in Theorem EITA) for the general stochastic evolution equation 
(2.16) without the assumption p > 2. 


3.3 Regularity of Mild Solutions to Stochastic Evolution 
Equations 


In this section, we shall consider the time/space regularities of mild solutions 
to the equation (BIÐ). 


3.3.1 Burkholder-Davis-Gundy Type Inequality and Time 
Regularity 


By comparing Theorems and BEIA, we see that the time regularity 
in the solution space L5(£2;C([0, T|;IR^)) for finite dimensions is a little 
better than that in CT([0, T]; LP (£2; H)) for the general stochastic evolu- 
tion equation (8-16). It is easy to see that, the difference comes from the 
use of Burkholder-Davis-Gundy type inequality for the stochastic involution 
“Jo SC — s)g(s)dW (s). 

We consider first the linear equation (E32). For this, we introduce some 
notations. Fix p> 1 and q > 1. Let Hı and Hə be two Hilbert spaces. Write 


T, (Hı; He) = 2 (J(.- ) € £a (Le (2; L^? (0, T; H1)); LE(Q; L*(0, T; H2))) | 
|J C. »eon;g) € Ly (9; L9(0,T))}. 
In the sequel, we shall simply denote Yp p(H1; H2) (resp. Yp p(H; H)) by 
N)(Hı; H2) (resp. T,(H)). 


Remark 3.16. Note that, for any J(-,-) € Yp,a(Hı; Ho), one does not need 
to have J(,-) € LẸ (Q; LP(0, T; £C(H3; H2))). Nevertheless, in some sense 
T5, 4 (H3; H2) is a nice “replacement” of the space Lg? (£2; L9(0, T; C(H3; H3))). 


Also, we introduce the following assumption: 


Condition 3.2 There is a constant Cp > 0 such that the following Burkholder- 
Davis- Gundy type inequality holds tor “fo SC — 8)g(s)dW(s)”): 

















e( sup | [ se-s) dW (s) 


EC gl» . . , 
E s e (3.51) 


Y g € L5((2; L’ (0, T; £2)). 
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Remark 8.17. For any two stopping times ø and 7 with 0 € o € r € T a.s., 
similarly to LE(2; C([0, T]; H)) and Lz(£2; L*(0, T; H)), one can define the 
Banach spaces L5(£2; C([o, 7]; H)) and L£(2; L*(o, r; H)). Under Condition 
BJ, one can show that 


| [ se- 9m aw(s) 


We believe that Condition holds for any Co-semigroup S(-) and p > 1. 
However, as far as we know, this is a longstanding unsolved problem. So far, 
the best known result is as follows: 














D 
) SS Col ole (o r2 (o, r.c2)» 








e( sup 
(5 lo, T] 


(3.52) 
V g € LE(Q; L? (0,7; £3)). 


Theorem 3.18. Condition ZA holds whenever one of the following conditions 
is satisfied. 

1) S(-) is a Co-group on H; 

2) S(-) is a generalized contractive Co-semigroup, i.e., |S(s)| e(g) € e? for 
some constant c € R and any s > 0. 


Proof: The first case is obvious. 

We now consider the second case. Without loss of generality, we assume 

= 0, ie. S(-) is a contractive semigroup. For this case, by Sz.-Nagy’s 
theorem on unitary dilations (e.g. BIZ, p. 29, Theorem 8.1 in Chapter I]), 
there exist a Hilbert space H and a unitary Co-group {U (t)}rer on H such 
that H embeds isometrically into H and I'U(t) = S(t) on H for all t > 0, 
where T is the orthogonal projection from H onto H. Therefore, taking any 
g € LE(Q5 L?(0, T; C9)), we get 


















































t 
E sup n S(t — s)g(s)dW (s)| =E sup a I'U(t — s)g(s)dW (s y" 
tc[o,T] ' Jo H tc[0,T] H 
$ p p 
=E sup |ru() o f U(-s)q(s)aW(s)| <E sup M ve jaw (s)| 
t€[0,T] 0 H t€[0,T] H 




















T p/2 p/2 
<E, | Usal 4)” < CoE T leG)2, cade) 


T p/2 
-ex( f lo(s)[2gds) 


where we have used the fact that Lo(V;H)- and (£Lə(V; H) =)L9-norms of 
g(-) coincide, because g(-) is Z$-valued. o 














Remark 3.19. It is easy to see that, when H is finite dimensional, S(.) is 
always a generalized contractive Co-semigroup. Hence, Condition is always 
satisfied when dim H « oo. 
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We have the following time-regularity results for mild solutions to the 
equation (EL32). 


Theorem 3.20. Let Condition EA hold, Xo € L (9; H), Ae N(H), Be 
Y(H; L3), F(C) € Le(£2; L1 (0,1; H)) and g() € L?(0; L?(0, T; £2)). Then, 
the equation (E32) admits a unique mild solution X(-) € LR(2;C([0, T); H)). 
Moreover, 


IX ()01zecosco.m]: 8) 
; (3.53) 


< (IXolzz. (0:5 + |fIzecoizi(o ri) + lglrz(o;2(0,T:c9)))- 


Proof: We first consider the case that A = 0 and B = 0. For such a case, 
the mild solution X(-) to (832) is still given by (B34). Using Condition 
(instead of Proposition BTA), similarly to (E33) (H-30), we have 


X(-)|12 (0:0 qo rn) (3.54) 
; l 


< (lXolzz, (ase + | flr2(@;01(0,7;4)) + l9lzzcoizo(o.r.c2)- 
By Proposition BJ, it is easy to see that X(-) € LA(Q; C([0, T]; H) 
t 


Now we handle the general case. For any a € R, denote by [a] 
integer less than or equal to a. Write 


J: 
he biggest 


1 
N= [= (Alec [coto + IlBle rem s costo, ry) | t1, 


where £ > 0 isa constant to be determined later. Define a sequence of stopping 
times ins as follows: 


melu) = int {t € (0.7) | (f VaGonlsnds)" 


(f B(s, 2) ege) = e 


i 
neo) int [1 € [nis T] (f A(s,w)leunds)” 





k—l,e 
i 
«(f Biound)? =e}. 
Tk—1,€ 
k=2 N. 


NM 


Here, we agree that inf) = T. 
Consider the following stochastic evolution equation: 


(s = (AX + f)dt+gdW(t) in (0, T], (3.55) 


X(0) — Xo. 
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Here f € LA(0;L'(0,T;H)) and à € Lb((2; L?(0, T; £9)). Clearly, (B58) 
admits a unique mild solution X € LZ(6;C([0, T]; H)). Define a map J : 
LOQ; C([0, 71,4]; H)) > LFC; e(o, ral: H)) as follows: 

LECO; C(O, Tie]; H)) 3 X > X = F(X), 


where X is the solution to (B55) with f and ĝ being replaced by AX + f 
and BX + g, respectively. We claim that J is contractive. Indeed, by means 
of (E52), for any X1, X2 € Le(£2; C([0, Tie]; H)), 


IZ (X1) — J'(X2)l7 » (o.c o, ni]; H)) 

















T s( sup | se- r)JAGG Fajara [5e rB - X)awrn)| )" 


(sp 














< CE( sup | [st oaa - Xa)dr| ) 


t€[0,71,«] 














«CE sup (| [ S(t — 7)BGS — Xo)aW(r) 


t€[0.71,«] 





) 
H 
p p Y Y. p 
= Ase Sle) [Al cca) loge as.) 7 Xelion) 
p p X. XP 
*C( sup 1802s) Blanes con IP lioc ay 


(3.56) 
. Then, from (8.50), we find that 





Let us choose € = 
4C supzey 0,7] LIS JI. L) 


" Es dos. By 
IJ (X3) n I (X2) lhe (o.c, m) < ju m Xal5»(oicqo;n idm (3.57) 


This implies that J is contractive. Thus, it has a unique fixed point X € 
LA(Q; C([0, T1 e]; H)), which solves (E12) in [0, 7;,.] (in the sense of mild so- 
lution). Inductively, we conclude that (B32) admits a mild solution X in 
[Th—-1,e;Tk,e] for k = 2,--- , N. Furthermore, 
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p 
L£(0:C([0,71,.]; H)) 








IA 








E sup (|stox0+ f stt x + ne 


tE[0,71,<] 


+ [ S(t—r)(BX aw) )" 
Ri 


+CE sup f S(t — r)BzdW (r) 
0 


t€[0,71,«] 





^ 
Q 











E sup (| [ S6- Axe 


t€[0,71,«] 














»1 


E wp. (Istoaxo- f se- r)fdr 4 [s r)gdW (r) 


tefo, T 

















- 








ap 


p 
- mE SOl) Manira on. X egeo atm) 


p 
«e( eT] Sle) |IBlecareg) [Lg cost. e» X Hagae qon ln) 




















+C( E 9 + Flee (a;23(0,7:H)) Se 9l eto. rao T.c9))- 
(3.58) 
This, together with the choice of 7;,., implies that 
IX [12 (2:0 to, ni a) 
F a (3.59) 


ES C(|Xol rs. (Q;H) + |f Ire (o i (oT i) + Igl re (.2;22(0,7:£9)))- 


Repeating the above argument, we obtain (8.53). The uniqueness of solutions 
is obvious. L1 


Theorem 3.21. Let Conditions Z1 and ZA hold, F(-,0) € LE(Q; L'(0, T; H)) 
and F(-,0) € Lg(2; L^(0, T; £9)). Then, for any Xo € L^. (9; H), the equa- 
tion (BIG) admits a unique mild solution X(-) € LR(Q; C([0, T]; H)), and 


IX (lre (oso (o,T]:2) 
z (3.60) 
&C(|Xolrs. (nyt FC. 0)|22(0;,21(0,7;H)) HFC, O) reco 2 (0,79) 


Proof: The proof is very similarly to that of Theorem ETA. 

Fix any Ti € [0, T]. Similar to the proof of Theorem BIA, we define a 
map J : Le(2;C((0, T1]; H)) > Lg(2; C([0, 71]; H)) by J(Y) = X for any 
Y € LR(2;C([0,T,]; H)), where X solves the equation (ELIT). To show that 
the map J is contractive for T1 small enough, we choose arbitrarily another 
Y e L2(0; C([0, T1]; H)), and define X = J (Y). Write X(-), Fi(-) and Fi(-) 
as that in the proof of Theorem BIA. Then X(-) solves (E22). By Conditions 
and p > 1, similarly to (E-43])- (EL28), we see that 
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[Filo (0,72) € CLC zr, lY CO) — Y Olreacq nm) (8-61) 
and 

LC) Ue (os r2(0,7.,c9) SCl) leor lY C) - Y re a;c(0,71):4))- — (3.62) 


Applying the estimate (B54) (for the linear problem) to the equation (44) 
(for X(-)) and noting (E-GT)-(E-82), we find that 


|X(- Je reto;c(o mm) 
<C(|F Slee nonm) MAC JM»recoiz2(o; c2») (3.63) 
€ C(L Oleo) + L2 )1z2(,7))IY C) — Y C)l1reto;ctpon]; m) 


Choose T; so that C(|L£1(-)|z2(0,74) + |L2(-)|z2(0,71)) < 1. Then, J is con- 
tractive. By means of the Banach fixed point theorem, J enjoys a unique 
fixed point X(-) € LR(Q; C([0, T1]; H)). Clearly, X(-) is a mild solution to the 
following equation: 


l dX(t) = (AX (t) + F(t, X(t))dt + F(t, X(t))dW(t) in (0, Ti], id 


X(0) = Xo. 
Using again Condition B and by X(-) € LA(Q; C([0, T1]; H)), similarly 


to (ELGT)-(E82), we see that F(, X()) € LE(05 D (0,7; H)), F(,X()) € 
L&(2; L? (0, Ti; £3)), and 
IFC, XC)lrero,r;a) + FC, XC) DE zz (cono (om c2) 
€ |FC.O)lrz(o; ri (or) + MF CO) [22(0;22(0,7,:£9)) 
+C (Ua )|px(o,) + |L2C) 


12(0,7,)) X C) ze (asc (por); 8) 


Therefore, similarly to (E:52]), we have 


X (J-|retoscqo,ri);) 


) 
« c(Ix olre (Qr) IFC, X C) zz coni (o, m) + EFC, X Olson.) 
< C|IXolis. cmn) + FO) recor (omn + MF CO) 22(2;22(0,71;£3)) 
+(|LZi(-)Iz2(0,74) + |Lal- ero.ry) lX Olzon]: 

(3.65) 
Since C (LIA C)0 zs (o7) + |L2(-)|22(0,7,)) < 1, it follows from (E) that 


XOlzzocqon]m) (3.66) 


C(IXolzz. (emt FC.) recor ort lE CS) locos r20,7;£9)): 
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Repeating the above argument, we obtain a mild solution to (E.IG). The u- 
niqueness of mild solutions to (BIA) is obvious. The desired estimate (ELGU) 
follows from (E60). This completes the proof of Theorem EZI. L1 


3.3.2 Space Regularity 


Sometimes we will need the space regularity of mild / Bos solutions to (#10). 

Generally speaking, the stochastic convolution Tot —s)F(s, X (s))dW (s) 
is no longer a martingale. Hence, one cannot apply ma Pals directly 
to mild solutions to (ELIG). For example, when establishing the pointwise 
identities (for Carleman estimates) for stochastic partial differentia equations 
of second order, we need the function to be second differentiable in the sense 
of weak derivative w.r.t the space variables. Nevertheless, this sort of problems 
can be solved by the following strategy: 


1. Introduce suitable approximating equations with strong solutions such 
that the limit of these strong solutions is the mild/weak solution to the 
original equation; 

2. Obtain the desired properties for the above strong solutions; 

3. Utilize the density argument to establish the desired properties for the 
mild/weak solutions. 


There are many methods to implement the above three steps in the setting 
of deterministic partial differential equations. Roughly speaking, any of these 
methods, which does not destroy the adaptedness of solutions, can be applied 
to stochastic partial differential equations. Here we only present an approach 
based on Lemma BI. To this end, we introduce the following approximating 
equations of (BIB): 


Dp od + R(J)F(t, X(t)))dt + R(X)F(t, Xa(t))dW(t) in (0,T], 


X, (0) = RJ Xp: 
(3.67) 
Here, A belongs to p(A), the resolvent set of A, and R(A) E A(AI— A)! 
We have the following result. 


Theorem 3.22. Let Condition KT hold and p > 2 (resp. Conditions ZA 
and IZA hold for some p > 1), F(,0) € Lb(2; L'(0,T; H)) and F(-,0) € 
L&(92; L? (0, T; £3)). Then, for each Xo € LE, (0; H) and À € p(A), the equa- 
tion (ELG7) admits a unique strong solution XX(-) € Cg([0, T]; Le (2; D(A))) 
(resp. XA(-) € LE(2;C([0, T]; D(A)))). Moreover, as A — oo, the solution 
Xy(-) converges to X(-) in Cg((0, T]; LP(2; H)) (resp. LE (2; C([0, T]; H))), 
where X(-) solves (ELTG) in the sense of the mild solution. 


Proof: We only consider the case that Condition B.I] holds and p > 2 
(Another case can be considered similarly). 
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Since AR(A) = A?(AI — A)! — Al is a bounded operator, by Lemma B, 
we obtain the existence of unique strong solution X, (t) to the equation (E62). 
Now we prove the convergence conclusion in Theorem BEZA. For any t > 0, 


X(t) — XX(t) 
= S(t) (Xo — R(A)Xo) + f S(t — s)(F(s, X(s)) — R(A)F(s, Xx(s))) ds 
+ il S(t — s)(F(s, X(s)) - RO)F(s, X (s))) dW (s). 


For any r € (0, T], we have that, 














sup E|X(t) — XA (t)[, € 3" (Ia 4 I2 + I3), 
t€[0.r] 


where 








I, = sup E f S(t — s)R(A)(F(s, X (s)) — F(s, Xx()))ds| 


te [0,r 














h= sup E [5 S(t — s)R(A)(F(s, X(s )) - Fs X (s) aW (o) |}, 























I; = sup E|S(t)(Xo — R(A)Xo) +f S(t — s)(I — R(A)) F(s, X(s))ds 


+f St - s)(I— R()) F(s,X(s))aW(s)| 


Since |R(A)| e(g < 2 for À > 0 large enough, by (230) and Condition BJ, 
similarly to (2-45), it follows that 























" t 
B < sup E| | [5 — ROF, X(9) — Fs. Xal) LAs] 
te€[0,r] 
<C sup a( f Iren - F(s, XX(s Yd s) 
te[0,r] 




















F(z, X(s)) — F(s, Xx (s DE) asl” 


<C sup Uf (E 
te[0,r] - J0 


€ CIL Clo (o sup E 
t€[0,r] 











X(t) - SOS 





Further, by means of the Burkholder-Davis-Gundy inequality (i.e., Proposi- 
tion BTJ), similarly to (E28), we have that, 











Ie! 





X(t) - X(t)];- 





I; €C|La()|5(o, SUP 
te€[0,r] 
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Hence, 











sup E|X(t) — HO 
te[0,r] 


< c Li): o, + M02 (,) 














sup E| X (t) = Xx + n|. 
te[0,r] 





Choose r so that C(ILa()[7:(9,, + |L20)lZ20,7)) < 1. Then, 





sup E|X(t) — Xat) € Cls. (3.68) 
t€[0.r] 











On the other hand, 











I; X 3" | sup E|S(t)(Xo — RO)Xo) |j 
t€[0,r] 








+ sup E f S(t— s) (I — RO)) FG X()ds|" (3.69) 

















+ sup E 1 sq — s)(I = RO) F(s, X(s))aW(s)|" ]. 


We now estimate each term in (#69). First, 


























sup E|S(t)(Xo — R()Xo)|7, € CE[Xo — R()Xo|7, —0, as A 00. 
t€[0,7] 


Next, by Condition BI again and Theorem BTA, we obtain that 











sup E 
t€[0.r] 





f Sq — s — RO) FG X(s))ds{ 
0 








<CE 














n zr RQ))F(, X (s))lrds|" —0, asA- oo. 


Similarly, by means of Proposition again, we have that 











sup E 
t€[0,r] 





1 stt - s(r - RN) Fle, X(W s)| 
0 





I — R(A))F(s, X(s))|2.0ds Pus 0, as À> oœ. 
0 fe 














<CE 





Hence, by (EGJ), it follows that 














sup E 
tE[0,r] 





X(t) — Xa (t)i € o(1), 


where o(1) — 0 as A > oo. Repeating the above argument, we deduce that 
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sup E[X (t) — X4 (0), € o(1) > 0, as À > oo, 
tc[0,1] 





which gives the desired convergence. L1 


Likewise, for any À € p(A), we introduce the following approximating 
equation of (8.32) with A = 0 and B = 0: 


a =(AX)(t) + R(A)f(t))dt + R()f(t)dW(t) — in (0,T], con 


XX(0) = R(A) Xo. 


By Theorem BIJ, from the proof of Theorem BZA, it is easy to show the 
following result. 


Corollary 3.23. For each p > 1, Xo € LE, (0; H), f(-) € Ll; L' (0, T; H)) 
and f(-) € LP (R; L?(0, T; £9)), the equation (S70) admits a unique strong 
solution XX(-) € Cg([0, T]; L^(42; D(A))). Moreover, as A — oo, the solution 
X)(-) converges to X(-) in Cp([0, T]; L (2; H)), where X(-) solves (B32) with 
A= 0 and B — 0 in the sense of mild solution. 


The following result shows the space smoothing effect of mild solutions to a 
class of stochastic evolutions equations, for example, the stochastic parabolic 
equation. 


Theorem 3.24. Let Condition EL hold, F(-,0) € LR(Q;L1(0,T;H)) and 
F(,0)€ LP(Q; L?(0, T; £9)) for some p > 1, and A be a self-adjoint, negative 
definite (unbounded linear) operator on H. Then for any Xo € LE (2; H), the 
equation (ZIB) admits a unique mild solution X(-) € L£(0;C(|0, T]; H)) à 
L2(Q; L*(0,T; D((—A)3))). Moreover, 


X Olgeta + XO reco rator ptc 3) (3.71) 
zx 3.71 
&C(|Xolze. cor VF CO) Drecoizi o may V CS 0) lg cosa to micg)- 


Proof: Clearly, A generates a contractive Co-semigroup. Hence, Condition 
hold. 

By Theorem BZZ, for each A € p( A), the equation (E67) admits a unique 
strong solution X)(-) € (Q; C([0, T]; D(A))), and jim X() = X(-) in 


LR (2; C([0, T]; H)). Moreover, 


Xa (-)|22(.2;0((0,7);4)) 


~ 3.72 
<C(|Xolze, (o ary* FC; O)| rz coz (0,72 |F C. 0)|recoz2(o,7:c2)) eee) 


for some constant C > 0, independent of A. 
Applying Itó's formula to |X4(-)|2; and using (B57), we obtain that 
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XX CD) — XX (0) [7 
T 


T 
=2 f (AXA) Xa(s)) gds 2 f (R(X)F (s, Xa(s)), Xa(s)) yds 


T " | (3.73) 
+2 | (LRQ) F(s, X4 (s), Xa (s) )  dW (s) 


T 
+f |RO)F(s, Xx(s Vegds. 


By (EL73), we see that 





n 

















E. as : 
f (C4) (S) ds 


< C[ELX (0), +E 


























T Pp 
f (R(A)F(s, Xa(s)), Xa(s)) yds : 








(3.74) 


yo 
2 





+H 


T ~ 
f (ORO) F(s, X (s), Xa (s) ) AW (s) 


«(f noy. Xy (5) [ad s) i 


It follows from Burkholder-Davis-Gundy inequality that 





























p 
n 


T ~ 2 
f (LRQ) F(s, Xa(s)), Xa (s) ) dW (s) 

















D 


< (f |F(s, Xa (s) [2X Gu ds) * 








(3.75) 








<ce[( f. Fo onlesas) "so. cols 


tc€[0,1] 
, [CJ Foxx X(s legs) 


By Condition ELT, it holds that 
T p 
&( f |F(s, Xx (s))[4,ds) i 
T 2 T 
si I |F(s. 0) [ods) + ( LG)|XxG)[ds) 


Ec FC O)l eto. r2 (o,T.c9)) + [L2 C) 52 (o,ry ocn gx (ls. 


Combining (EL72), (874) and (ELT3)- (E78), we end up with 


p 
2 











Q 





+ sup XI]. 
te[0,T 


p 
2 





< 


Q 





| (3.76) 
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= 


H 














PL us : 
4 \(-A)EXy(s) 2d 


(3.77) 
&C(|Xolze. (antlF(. Oleg asc20,7.)t FC 0) Ire osa tos c2)- 
Similarly, one can further show that 
; i i 
lim. |(—4)2 XA() — (74)? X,()|re(oz2(o,T;2)) = 0- (3.78) 


A.n—0o 


By (E78) and noting that (—A)2 is a closed operator, we conclude that X(-) € 
L^(0; L?(0, T; D((—A)3))). By (E272), it is easy to see that the estimate (B27) 
holds. Oo 


3.4 Notes and Comments 


Since the seminal work in [1456], stochastic differential/evolution equations 
were studied extensively in the literature and attracted a great interest even 
today. Detailed introduction to stochastic differential equations (resp. stochas- 
tic evolution equations) can be found in [267 284] (resp. [68, £T, 223]), etc. 

Throughout this book, stochastic integrals appeared in stochastic differ- 
ential/evolution equations are understood in Itó's sense. For different defi- 
nitions of stochastic integral, one has different types of stochastic differen- 
tial/evolution equations. By a simple transformation, a stochastic differen- 
tial/evolution equation in Stratonovich's sense can be reduced to that in Itó's 
sense. On the other hand, we refer the interested readers to [IU5), 130, 249] for 
the study of stochastic differential/evolution equations when the Brownian 
motion is regarded as a rough path. 

In this chapter, we only consider stochastic evolution equations with the 
nonlinearities satisfying (2.39). Such kind of assumptions are essential in the 
proofs of Theorems ETA and EZI. To drop it, generally speaking, one has to 
assume that the nonlinearities have “good” signs (e.g., [68]). 

When studying the stochastic evolution equations driven by cylindri- 
cal Brownian motions, we assume that the integrand is a Hilbert-Schmidt 
operator-values process. Without this assumption, people usually need some 
conditions on the operator A, for example some smoothing effect of the Co- 
semigroup generated by A, to show the well-posedness of the corresponding 
stochastic evolution equation (e.g., [72]). 

Almost all results presented in this chapter are either well-known (e.g., 
[68]) or small modification of the known ones. The very simple proof of the 
second case in Theorem is due to E. Hausenblas and J. Seidler ([L38]). 
The space 1,4 (Hi; H2) introduced in (EL5U) seems to be new; while Theorem 
was taken from [248], which can be viewed as an infinite dimensional 
counterpart of the related result appeared in (284, Chapter V, Section 3]. 





Check for 
updates 
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Backward Stochastic Evolution Equations 


In this chapter, we present an introduction to backward stochastic evolution 
equations (valued in Hilbert spaces), which appear naturally in the study of 
control problems for stochastic distributed parameter systems. In the case of 
natural filtration, by means of the Martingale Representation Theorem, these 
equations are proved to be well-posed in the sense of mild solutions; while 
for the general filtration, using our stochastic transposition method, we also 
establish their well-posedness. 

Throughout this chapter, T > 0, (Q, F, F,IP) (with F ££ ieto 3) isa 
fixed filtered probability space satisfying the usual condition, and we denote 
by F the progressive o-field w.r.t. F; H and V are two separable Hilbert 


spaces; we denote by J the identity operator on H, and write £} 4 Lo(V; H). 


4.1 The Case of Finite Dimensions and Natural filtration 


In this section, we consider backward stochastic differential equations, i.e., 
backward stochastic evolution equations in R” (for some n € N). It is well- 
known that, for a deterministic ordinary differential equation, the terminal 
value problem on [0, T] is equivalent to an initial value problem on [0, T] under 
a simple time transformation, i.e., t — T' — t. However, things are completely 
different in the stochastic setting. Indeed, for stochastic problems one cannot 
simply reverse the “time” when looking for solutions that are adapted to the 
given filtration F. As a result, one has to introduce some new idea to treat 
the terminal value problem for stochastic differential equations. This leads to 
a new class of differential equations in the stochastic setting, i.e., backward 
stochastic differential equations. 

To begin with, let us analyze how to formulate correctly backward stochas- 
tic differential equations. 

Let W(-) = (W!(,--- ,W"(-))' (for some m € N) be an m-dimensional 
standard Brownian motion, and F = [Jj;cjo 7; be the natural filtration 
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generated by W(-). Consider the following simple terminal value problem for 
stochastic differential equation: 


l dy(t) = 0, t € [0,T], 


(4.1) 
y(T) = yr € LZ, (0). 


We want to find an F-adapted solution y(-) to (ELT). However, this is im- 
possible since the only possible solution to (ELT) is y(-) = yr, which is not 
necessarily F-adapted (unless yr itself is Fp-measurable). Namely, the equa- 
tion (ELT) is not well-formulated if one expects to find an F-adapted solution. 
In what follows, we will see that the following modified version of (ÆT): 


k = Y (t)dW (t), t € [0, T], 
(4.2) 
y(T) = UT 


is an appropriate reformation of (ÆT). Comparing (4) with (ELT), we see that 
an additional term, i.e., Y (t)dW (t), has been added. The process Y (-) is not 
a priori known but a part of the solution! As a matter of fact, the presence 
of the term Y(t)dW(t) “corrects” the “non-adaptiveness” of the original y(-) 
in (ET). 

Generally, we consider the following backward stochastic differential equa- 
tion: 


| dy(t) = h(t, y(t), Y (t))dt + Y (t)dW (t), t € [0, T], (43) 


y(T) = yr. 


Here yr € L4, (Q;R”) and h : (0, T] x R” x R?*? x Q — R” is a given 
function. The main goal of this section is to find a pair of F-adapted processes 
y: [0,T] x 2 — R” and Y : (0, T) x Q > R”*™ satisfying (3) in a suitable 
sense. 

Similarly to Definition B, the following notion of solution to (L3) seems 
to be the most natural one. 


Definition 4.1. A pair of stochastic processes (y(-),Y (-)) is called a solu- 
tion to (ŒA) if y(-) is an R”-valued, F-adapted, continuous process, Y (-)) € 
Lg (0, T; gum, h(,yC), Y (-)) € L'(0, T; R”) a.s., and for each t € [0, T], 


T T 
v -w - f h(s.u() Y (s)ds - | Y(s)dW(s), as. (4.4) 


Equation (ŒA) is said to admit a unique solution if for any two solutions 


(yC), Y C)) and (9(-), Y (-)) to (3), it holds that 


P({y(t) = g(t), Vt € (0, T]}) =1, P((Y(t) 2Y(0))) =1, ae. te [0, T]. 


In the rest of this section, we assume that: 
1) h(-,y, z) is F-adapted for each y € R” and z € R?*""; and 
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2) h(-,0,0) € L2(2; L1 (0, T; IR")), and there exist two nonnegative func- 
tions L41(-) € L!(0, T) and La(-) € L?(0, T) such that 


R(t, y, z) — h(t, 9, £)]n < Li(t)ly — Glen + Lo(t)]z — lan, 


(4.5) 
V y, ĝ ER”, z2 2e R"*". a.e.t € 0, T], as 
One has the following well-posedness result for the equation (EL3). 


Theorem 4.2. For any given yr € L*-. (2; R"), the equation (ŒJ) admits a 
unique solution (y(-), Y (-)) € L2(02; C([0, T]; R”)) x L2(0, T; R"*""), and 


Iy 


(-), Y C)lza(o;cto, Tg) x 12(0, T; 7) 
< C(lyr|za, (arn) + |A(-, 0, 0)|ra(a;210,7sR")))- 


(4.6) 


Proof: For s € [0,T), put 
V(s, T) $ 12(2; C((s,T];R”)) x IRo, TR): 


We divide the proof into two steps. 


Step 1. In this step, we shall show that, for any h(-) € L2(0; L1(0, T; R”)) 
and yr € L3} (2; R"), there is a pair (y(-), Y (-)) € V(0, T) such that 


F T 
m Ea f hiuc f Y(sdW(s, Vtel)T| as. (47) 


Indeed, put 


























M(t) -E (vr — [^ s)ds | Fi), y(t) =E (vr — [ h(s)ds | A). (4.8) 








Then, M(0) = y(0) = EM(T). By the Martingale Representation Theorem 
(i.e., Theorem 214d and Remark 2148), one can find a Y (-) € L2(0, T; IR") 
such that 








+ f Y (s)dW (s). (4.9) 


Hence, 






































T T 2 
[| tois < EIM) 2E (lk. +Ò | Olend) ]. (410) 


From (I9), we see that 


T 
w- f h(s)ds = M(T O+ f Yo JaW (s O+ f Yt JaW (s 
0 


and 
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t 


y(t) = M(t) + f eaa f Y (s)dW (s) + f ida 


BON i oef Y (s)dW (s). 


Hence, y(- ) + Jo Y (s)aW (s) + fy h(s)ds. By the fourth conclusion in 
no i» is easy = see that y(-) € L2(2; C([0, T]; R”)). From (£8), 
it follows ue 


T 2 
WOlžzacuo,rry € CE [vrl + ( f Wed) |. (4.11) 


By (ELIU) and (Æ), we see that (y(-), Y (-)) satisfies 


























KC. YO) < cer  ( f qoan)]. — au» 


Step 2. Fix any Ti € [0, T). For any fixed (zC) jJ; Z(-)) € V(T,,T), it is 
easy to see that h(-) = h(-, 2(-), Z(-)) € L2(Q;L1(T1,T;R”)). Consider the 
following backward stochastic differential equation: 


dy(t) = h(t, z(t), Z(t))dt + Y(t)dW(t), t € [1, T), 
y(T) = YT. 


By the result in Step 1, the equation (ILT3) admits a unique solution (y(-), Y (-)) 
€ V(Tı, T). This defines a map J : V(I3,T)  V(T3,T) by (z(),Z()) 5 
(y(-), Y C). 


We claim that, for T, being sufficiently close to T, 


(4.13) 


(s 2) - J( Dyer, T) = < jle a= E Z)lyen y 
Y(z, Z), (Z, xe Ven p 


To show (ELT4), put (9(-), Y (:)) = J (z, Z)- J (8, Z) and h(-) = h(-, z(-), Z(-))— 
h(-, 2(-), Z(-)). Then, (9C), Y (-)) solves 
)= 


k g(t) = h(t)dt +Ê (dW, | te(n,T), 
ĝ(T) — 0. 


(4.14) 


(4.15) 


From (Æ) and using (£5), we find that 














T 2 
IC Y OR. $B f. Oldi) 


T - 2 
-cE( f htt, 2), Z) — alt, 20), Zt) Ine dt) M 
T 


< C(Ia lien m + La ec) EO) 7 20: Z0 7 ZO) m 














4.2 The Case of Infinite Dimensions 161 


and 














Ii. Y OR y € CE llt + ( f. Inte zer) 


1 


4.17 
S C(lyrlia, (or) + Ih (^, 0,0)]22 t0. r: (o, R7) ( ) 
+C (|La (l a,r) + Olz mlO, Z Clicr my: 
Let us choose T3 such that 
1 
C(L linm) + 2002207) € T (4.18) 


Then, by (£18), we get (414). This implies that the map 7 is contractive. 
Hence, it admits a unique fixed point, which is a solution to (EL3) on [T1, T]. 
Moreover, by (ELT2)- (E T8), it follows that 


lv), YO) an m) < C(lurliz, (2R) + |A(-, 0,0)[72t9.r: (o, )))- (4.19) 


Repeating the above argument, we obtain the existence of solutions to (23). 
The uniqueness and the estimate (ZG) follow from (ELT9). Oo 


4.2 The Case of Infinite Dimensions 


In the rest of this chapter, W(-) is a V-valued, Q-Brownian motion or cylin- 
drical Brownian motion but we only consider the case of cylindrical Brownian 
motion. 

We consider the following backward stochastic evolution equation: 


dy(t) = —Ay(t)dt + F(t, y(t), Y (t))dt + Y(t)dW(t) in [0, T), (4.20) 


y(T) = yr. 


Here and in the rest of this chapter, yr : R — H is an Fr-random variable, A 
generates a Co-semigroup (S(t));so on H, and F : [0,T] x Qx Hx L8 > H 
is a given function. 


Remark 4.3. The diffusion term “Y(t)dW(t)” in (220) may be replaced by a 
more general form (F(t, y(t)) +Y (t))dW (t)” (for a function F : [0,T] x 2 x 
H — £9). Clearly, the later can be reduced to the former one by means of a 
simple transformation: 


a=), YQsFGvy9)-YC. 


under suitable assumptions on the function F. 
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It is easy to see that, for any f(-) € Ly'?°(0,T; H), the following equation 


dy(t) = —Ay(t)dt + f (t)dt + Y (t).aW (t) in [0, T), 
(4.21) 
y(T) — yr 
is a special case of (4.20), in which the function F(-,-,-) is independent of y 
and Y. 


4.2.1 Notions of Solutions 


Similar to the case of stochastic evolution equations considered in the last 
chapter, we introduce below notions of strong/weak/mild solutions to the 
equation (420) (Recall (2132) for the notation ((-, - )) y). 


Definition 4.4. An H x £9-valued process (y(-), Y (-)) is called a strong solu- 
tion to (E20) if 

1) y(-) is F-adapted and continuous, Y (-) € L2"°*(0,T; C9); 

2) y(t) € D(A) for ae. (t,w) € [0, T] x 2, and Ay(-) € L1(0, T; H) and 
F(yC), Y ()) € L'(0, T; H) a.s.; and 

3) For any t € [0, T], 


T T 
v =ur+ f (Aul) - Ftssa(5) Y ()))ds— f Y(s)dW(s), as. (4.22) 


A 4.5. An H x C9-valued process (y(-), Y (-)) is called a weak solution 
to (E20) if 
1) y(-) is F-adapted and continuous, Y (-) € I5 £9), and F(-, y(-), 
Y () € L! (0, T; H) a.s.; and 
2 For any t € [0, T] and y € D(A*), 


T 
(y(t)m)g = (Ur n)a +f (y(s), A*) pds 


T aT 
-f (F(u) Y (9), mds - f (Y (s), n) ydW(s), a.s. 
(4.23) 


4.6. An H x C9-valued process (y(-), Y (-)) is called a mild solution 
to (20) if 
1) y(-) is F-adapted and continuous, Y (-) € TOP £3), and F(-,y(-), 
Y(-)) € L! (0, T; H) a.s.; and 
2 For any t € [0, T], 


(4.24) 
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It is easy to show the following result. 


Proposition 4.7. If (y(-), Y (-)) is a strong solution to (U.ZU), then it is also a 
weak solution to the same equation. Conversely, if a weak solution (y(-), Y (-)) 
to (4.20) satisfies that y(t) € D(A) for ae. (t,w) € [0, T] x 2, and Ay(-) € 
L!(0, T; H) a.s., then (y(-), Y (-)) is also a strong solution to (E-ZU). 


Similarly to Theorem BIO, we have the following result concerning the 
equivalence between weak and mild solutions to the equation (EEZU). 


Theorem 4.8. An H x £9-valued process (y(-), Y (-)) is a weak solution to 
(4.20) if and only if it is a mild solution to the same equation. 


Proof: The “only if? part. Let (y(-), Y (-)) be a weak solution to (ELZU). 
For any ó € D((A*)?), t € [0, T] and r € [t, T], by (£23), we obtain that 


(u(r), S(r — t)* A*0) y 


T 
= (yr; S(r — t) A" P) y + i (y(s), A*S(r — t)* A* 9) yds 
T 
-f (F(s, y(s), Y (s)), S(r — t)* A*à) yds 


q 
z / (Y (5), S(r — )* 4*4) 4dW (s). 


Integrating the above equality w.r.t. r from t to T', we obtain that 


T (y(r), S(r — t)* A à) ,dr = h + Ib — Ia — la, (4.25) 
where T 
né f (yr, S(r — t)* A*9) ydr, 
T T 
nf / (y(s), A* S(r — t)* A* 9) , dsdr, 
T T 
naf l (F(s, y(s), Y (s)), S(r — t)* A* à) „dsdr, 
nef [ow S(r — t)* A* 9)) jdW (s)dr. 
We have 


T 
h= (ur, f S(r — tt A*édr) = (yr. S(T — t)*ó — b) y (4.26) 


By Fubini's theorem (i.e., Theorem 221), we obtain that 
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T s 
=f f (y(s), A* S(r — t)* A* $) , drds 
T 


» (4.27) 
-f na (y(s), A* à) ds 
and 
I3 = ra [ S(r — t)“ A*$) , drds 
2 [ (F(s,y(5), Y (3), S(s — 2)*) ds (4.28) 


T 
— 1 (F(s, y(s), Y (s)), $} yds. 


Further, by the stochastic Fubini theorem (i.e., Theorem ZIM), we conclude 
that 


D= [ [ow (r — t)* A*¢)) ,,drdW(s) T 


VA 
2 f (Y (3). S(s — 2*6) gdW(s) - | (Y (3), 0) 4dW(s). 


From (ELZ3)-(EL2J) and using (2.23) again, we obtain that 


T 
(u(0.0), = (yr. S(T - t 6), = (F(s,y(s), Y (s)), S(s — t)*¢) yds 


T 
E f (Y (s), Ss — )* 6) gdW (8). 


which implies that 


T 
(y(t), 6), = (S(T =- HYT: $) y -f (S(s — t)F (s, y(s), Y (s)), $) ds 


T 
-[ (S6-O¥ ©), oy, ave. 
t 
(4.30) 
Since D((A*)?) is dense in H, we see that (Œ30) holds for any ¢ € H. There- 
fore, (y(-), Y (-)) is a mild solution to (420). 


The “if? part. Assume that (y(-), Y (-)) is a mild solution to (£20). By 
(£24), for any n € D(A*), t € [0, T] and s € [t, T), it holds 


(y(s), A*n)g 


T 
= (yr, S(T = sd -f (F(r y(r), Y (r)), S(r = s)*A*n) ydr 


IT 
- J (Y (r), S(r — 5) An} pW (r). 
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Integrating the above equality w.r.t. s from t to T, we find that 


T 
| (y(s), A*n) yds = Is — Io — Iz, (4.31) 
where 5 
2 [ (yr, S(T — s)*A*n) ds, 
T pT 
a2 [ f (F(r,y(r), Y (r)), S(r — s)* A*n) ydrds, 
n2 f f esse rry pawns 
Clearly, 


T 
I; = (ue. [ S(T — s)" A*nds) = (yr, S(T — t)*n) , — (yr,m),- (4-32) 


By means of Fubini’s theorem, we get that 


T r 
Ig = f | (F(r, y(r), Y (r)), S(r — s)*A*n) ydsdr 
T 
= / (F(r, y(r), Y(r)), S(r — t)*n) ydr (4.33) 


T 
ej (Fr, y(r), Y (r)), n} ydr- 


By virtue of the stochastic Fubini theorem, we obtain that 


T r 
ji J (J (Y (r), S(r — s A*n)) y dsdW (r) 
EN (4.34) 


T T 
=f OSE- W- f. (maa. 
t 
From (EC3T))- (E32) and noting (424), we find that (y(-), Y (-)) satisfies (23). 
This implies that (y(-), Y (-)) is a weak solution to (4220). o 
Similar to Lemma B, we have the following result. 


Lemma 4.9. A mild solution (y(-), Y (-)) to (E20) is a strong solution (to the 
same equation) if the following three conditions hold, 

1) yr € D(A), S(s — t)F(s,u(s,Y(s)) € e and S(s — t)Y (s) € 
Lo(V; DA )) for any t € (0, T] and s € [t, T], a 


a | [ |AS(s — t)F(s, y(s), Y (s))| udsdt < co; and 


» f f laste -oy (s)|Zgdsdt < oo. 
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Proof: Recall that for every t € [0, T], y(t) satisfies (£24). By the condi- 
tions in Lemma EL9, we see that, for any t € [0, T] and a.s., y(t) € D(A), 


T T 
d S(s — t)F(s,y(s), Y(s))ds = l AS(s — t)F(s,y(s), Y (s))ds, (4.35) 


T 
af si S(s — t)Y (s)dW (s) = L AS(s — t)Y (s)dW (s). (4.36) 


t 


From (ELZ4) and (EL35])- (E38), we find that for any t € [0, T], 





Ay(t) = AS(T — t)yr [ Aseen Y Ou 


; (4.37) 
- T AS(s — t)Y (s)dW (s). 


t 
Hence, Ay(-) € L!(0, T; H) a.s. This, together with Proposition I2 and The- 
orem ÆA, implies that (y(-), Y (-)) is a strong solution to (420). o 


In the sequel, we will need the following assumption on the nonlinearity 


n (£20). 


Condition 4.1 F :[0,T] x 2 x H x £9 > H is a given function satisfying 
1) F(-,y,z) is F-adapted for each (y,z) € H x £9; and 
2) There exist two nonnegative functions L1(-) € L!(0,T) and La(-) € 
L?(0, T) such that, for any y1, y2 € H, 21,22 € LÌ, a.e. t € [0, T], 


F(t, y1, 21) - F(t, yo, 22)|u < Li()|y1 — val n + Lo(t)|21 — z2|c9, as. (4.38) 


Generally speaking, it is impossible to find mild solutions to (420) under 
Condition ÆI except for the case of natural filtration (See the next subsection). 
Because of this, in Section ÆA we shall introduce a weaker concept of solution 
to (4.20) for the case of general filtration. 


4.2.2 Well-Posedness in the Sense of Mild Solution for the Case of 
Natural Filtration 


In this subsection, we assume that F' is the natural filtration generated by the 
underlying Brownian motion W(-). 

Similar to Theorem ETA, we have the following well-posedness of (2220) in 
the sense of mild solution. 


Theorem 4.10. Let Condition HJ hold and F(-,0,0) € L1L(0, T; L?(Q; H)). 
Then, for any yr € L5. (0; H), the equation (20) admits a unique mild 
solution (y(-),Y (-)) € I2; C([0, T]; H)) x L2(0, T; £9). Further, 


I(y(- 


), ¥C))|22(@;¢((0,7);4)) x L2(0,T;£9) 
<C(| yr | 12, (OH) T FC, 0,0) [ri toT; 12 (0:2) 


(4.39) 
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Proof: For any s € [0, T), let X[s, T]  2(0; C([s, T]; H)) x L2(s, T; £9). 
In what follows, we divide the proof into two steps. 

Step 1. In this step, we consider the linear equation (ÆZI) with f(-) € 
L$(0, T; L? (0; H)) and yr € L}, (0; H). 

By the Martingale Representation Theorem (Theorem ZIZI), there is an 
l(-) € L2(0, T; £9) such that 


























E(yr | Fe) = Eyr +f l(c)daW (c). (4.40) 


By Corollary 214, there is an A(-,-) € L'(0, T; L2(0, T; £9)) such that for 
ae. s € [0, T], 


























f(s) = Ef(s) + I ienaa (4.41) 
0 
and 
IAC do, z2(0,7c9)) € IFO to miz2 (0 (4.42) 
Put " 
y(t) = E(s(T - yr — f S(s — t) f(s)ds | m (4.43) 


This, together with (240) and (Ææ), implies that 


v = ser - ovr - f tome) 


" . (4.44) 
-f S(s — t) (f(s) +f h(s, o)dW (0) ) ds. 
From the stochastic Fubini Theorem, we get that 
T T 
y(t) = (0 -tyr~ | -Dds | str-oueymo) 
T pT 
-f ni S(s — t)h(s, oc)dsdW (c) (4.45) 
T T 
= S(T — yr — f S(s — t) f(s)ds — f S(s — t)Y (s)dW (s), 
where " 
Y(s) S str — s)i(s) + | Syk (4.46) 


Hence, (y(-), Y (-)) is a mild solution to (ŒZI). 
From (443) and (Æ), and noting (EL), we find that 


Iu); Y C)lxtom < C(lurlzz, (aH) + |f()iz30,7;12(2;4)))- (4.47) 
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Step 2. Fix any Tı € [0, T). For any fixed (z(), Z(-)) € X (11,7), it is 
easy to see that F(-,2(-), Z(-)) € LE(T3, T; L?(Q; H)). Consider the following 
equation 


br = —Ay(t)dt + F(t, z(t), Z(t))dt +Y (dW (t), te (n,T), 
(4.48) 


y(T) = yr. 
By the result in Step 1, the equation (448) admits a unique mild solution 


(y), YC)) € X(11, T). This defines à map J: X(I3,T)  X(T3,T) by 
(20), Z() e WYO. 


We claim that, for T, being sufficiently close to T, 


E 1 a 
| (2, Z) -= J (Z, Z) ven m < 3l 4) n E Z)| ven, ry 


VE. E,Z) etn. T 


(4.49) 


To show (E29), put f(-) = F(420) Z()) - FC, 20). ZC) and (90), C) = 
J (z, Z) — J (Z, Z). Then, ($(-), Y (-)) satisfies 
l dg(t) = —Ag(t)dt + f(t)dt + Y(t)aW(t, | te(n,T), Go 


207) s 0. 
From (£47), we find that 
GO. € X m € CIEC 20) Z0) — FG 20; 24) T00) 


< C(LLi C) n, my + ILo C) loe, rm I GC) mv ZO) en, m 
(4.51) 
and 


(y, Y QJ m € C(Isrlis. (on + [FC zC), Zanna) 


< C(lyrlia, (oun) + |F(-,0, 0)[2: er, m z2(0.1)) 


C (|L (Ol nr) + ILO) lizm m) GC); Z C) m 
(4.52) 
Let us choose T1 such that 


1 
C(L Olin, m + Lelia) < T (4.53) 
Then, by (E51), we get (£49). This implies that the map J is contractive. 
Hence, it admits a unique fixed point, which is a mild solution to (ELZU) on 


[71, T]. Moreover, by (E-52)-(E-53), it follows that 


lv), Y CDI m € C(lrlza. (aun + |F(-,0, 0)I7: tor 12 (9:1) (4.54) 
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Repeating the above argument, we obtain the existence of mild solutions to 
(£20). The uniqueness and the estimate (2239) follow from (454). o 


Similar to the proof of Theorem B24, we can show the following result, 
which describes the smoothing effect of mild solutions to a class of backward 
stochastic evolution equations. 


Theorem 4.11. Let Condition Q] hold, F(-,0,0) € L1(0, T; L?(0; H)), and 
A be a self-adjoint, negative definite (unbounded linear) operator on H. Then, 
for any yr € L*. (9; H), the equation (ELZU) admits a unique mild solu- 
tion (y). Y C)) € (La(Q; C([0, T]; H)) à L&(0, T; D((—A)2))) x Z(0, T; £9). 


Moreover, 


lu(JlIzz(o;ctom] m) + yO rac pa) +|¥(-)|2200,7;29) T 
= C(IYr|za. (0:1) + [F(,0, 0) [rior 12 (0:2) 


As the case of stochastic evolution equations in infinite dimensions, we 
cannot employ Itó's formula for mild solutions to backward stochastic evolu- 
tion equations directly on most occasions. Indeed, usually the mild solution 
does not have enough regularity. Nevertheless, similarly to the last chapter, 
the problem can also be solved by the following strategy. 


1. Introduce suitable approximating (backward stochastic evolution) equa- 
tions with strong solutions such that the limit of these strong solutions is 
the mild or weak solution to the equation (EZU). 

2. Obtain the desired properties for the above strong solutions. 

3. Utilize the density argument to obtain the desired properties for mild/ weak 
solutions to (420). 


Similar to the case of stochastic evolution equations, there are many mays 
to implement the above three steps for backward stochastic evolution equa- 
tions. For example, for each À € p(A), we may introduce an approximating 
equation of (2.20) as follows: 


l dy (t) = —Ay)(t)dt + R(A)F (t, ya (t), Ya (t))dt + YA(t)aW (t) in (0, T], 


ya (T) = R(A)yr, 
(4.56) 
where R(A) = A(AI — A) !. 
By Lemma ÆJ, similarly to the proof of Theorem BZA, one can show the 
following result. 


Theorem 4.12. Let Condition H] hold and F(-,0,0) € L$(0, T; L7(Q; H)). 
Then, for each yr € L3} (Q; H) and A € p(A), (5G) admits a unique strong 
solution (yX(-), YAC)) € L2(2; C([0, T]; D(A))) x L2(0, T; £2). Moreover, as 
X» 00, (C), ¥AC)) converges to (y), Y C). (in. L9; OUO T]; H)) x 
L2(0, T; £9)), the mild solution to (20). 
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4.3 The Case of General Filtration 


In this section, we shall employ the stochastic transposition method (devel- 
oped first in our paper [241] for backward stochastic differential equations) to 
introduce another concept of solution, i.e., the transposition solution, to the 
equation (LLZU). This sort of equation will play an important role in estab- 
lishing the Pontryagin type maximum principle for optimal control problems 
of stochastic evolution equations in infinite dimensions. It is notable that we 
do not assume the condition that F is the natural filtration, and therefore 
we cannot use the Martingale Representation Theorem (Theorem ZIZI) any- 
more. Instead, as we shall see later, the Riesz-type representation theorem 
presented in Chapter Ø (i.e., Theorem 255 or more precisely Theorem E73, 
established in [239]) will play a fundamental role to derive the well-posedness 
of (420) in the sense of transposition solution. 

Throughout this section, we assume that yr € L4- (9; H)) for a given 

€ (1,2] unless other stated. 

In order to define the transposition solution to (ELZU), we introduce the 
following (forward) stochastic evolution equation: 


l dz = (A*z + vı)ds + v3dW(s) in (t, T], 
z(t) — n, 


s t € [0,7], vi s LL T; LQ; zn v; € LE(Q;, L(t, T; £9), n € 
2. (Q; H), and q = zF4. By Theorem ETJ and noting (230), the equation 
EUM admits a uan. mild solution z € Cg([t, T]; £9(Q; H)), and 


(4.57) 


|z| cs (tt): e (9:8) 
(4.58) 
< C (Inles (om) + [vil ria, T; Lan) + |v»| ra co:z2(t:c8))- 


We now introduce the following notion. 


Definition 4.13. We call (y(-), Y (-)) € Dg((0, T]; L” (2; H)) x L2(0, T; Le (9; 
L3)) a transposition solution to the equation (20) if for any t € [0,1], 
vi() € Le(t,T; L3(2; H)), vo() € LECOQ; L*(t,T; £2)), n € D, (0; H) and 
the corresponding solution z € Cp([t,T]; L*(2; H)) to (cam), it holds that 
(2(-), FO, s YO» € Lp(Q;L*(t,T)), and 


T 
E(z(T), yr) gy — J (z(s), F(s, 8))) yds 
T T 
-E(n.(0), +E f (vx (5), (s) yds +E ef va(s), Y (s)) pods. 


Before showing the well-posedness of (F220) in the sense of transposition 
solution, we collect some preliminaries. 

First, we need the following technical result, which can be viewed as a 
variant of the classical Lebesgue Theorem (on the Lebesgue points). 























(4.59) 
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EE 1 
Lemma 4.14. Assume that a € [1,00), a’ = — y esse r € 


oo, if a=1, 
(1,00), r' = ="), fi € L(0,T;L°(Q;H)) and fa € Ly (0,T; L” (92; H)). 
Then there exists a monotonic sequence {hn}, of positive numbers such 
that lim hn = 0, and 
n-—oo 


























1 tthn 
lim x E(fi(t), fa(r)) udr = E(fi(t), fa(t) gu, ae. t € [0, T]. 
fo, te (0, T], 
0, te (7,27). 


[Pliz 0.2720" cour) = Vale’ orrom) = Vl voirie! (aun) By Lemma 
276, for any € > 0, one can find an f} € Cg([0,2 T]; L^' (2; H)) such that 


Proof: Write fz = { Then, f; € L} (0, 2 T; L” (2; H)) and 


F 0 
| fo a Faleg (0,27; L (2:8) <e. (4.60) 
Thanks to (EEGU), we find that 























T 
] [eio ena -EOR On| a 


x (4.61) 
X [fileo remma filer oor ce (oy Vado og oir con 





Utilizing (50) again, for ^ € (0, T), we see that 




















[EL eo, aen - 1 [ mn se) nara 




















E SAP Efi (t), f(T) — f2(7)) ndr |dt 


1 T tth 7 : 
< T f Ifa Clos, (oi for) — fo Pleg (o;mdrdt 


t+h t+h i 
S ‘(ff Alig _(amarat) YJ |fo(r TQ / (o olrii)" 


Afr! 
= |filrpor zem aem ete, Lo! die 


"T - 1/r' 
= |filzzo,7;L2(2;H)) Gf [| fo). PIG mdtdr) 
2T 1/r' 
< [fi] LEO, T; Le (0:2) Gf f IRA- POK La! ' (odd) 


< elfilzz,7;L(2;H)): 
(4.62) 
On the other hand, by the uniform continuity of f9(-) in LY (N; H), one 
can find a 6 = ó(£) > 0 such that 
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I5) — fa(s2)lzor (am) $ & V 51,82 € [0,27] satisfying |s1 — s2| < ô. 
T 


Hence, for each h € (0,6], we have 


























[Fu Efi (t), f9(7)) adr — EU: (0. f2 (0) ldt 














1 fT, ptth 
=> EC (t), f2(7) — f2(0) ndr dt 
iA d ^ | (4.63) 


IA 


1 T ptth 
3 | filing, cos fT) — f2 (Ire, (o, ydrdt 


T 
< ef Ifi Oleg (mdt < Ce|fi|rz(o, i (0;1)- 
0 
By (EEGI), (£52) and (53), we conclude that, for h € (0, ô] 
T 
| 


This leads to 


T 


























t+h " z 
2 ECF (t), fa(r)) udr —ECRi (t), fot) a 


dt < C&|filrz(o,;ze (0:2) 








(filt), fal) udr — E(f (t), folt)) x 














Gp. 


lim 
h—0 0 











dt — 0. 





1 fttr 
id 
Hence, one can find a monotonic sequence {h,,}°2, of positive numbers with 
lim hp = 0 such that 

n—- oo 








poft 7 7 
lim =f E(fi(t), fa(r)) udr = E( f1 (t), f2(t) u, ae. t € [0, T]. 


noo hy, 


























By this and the definition of f2(-), we conclude that 


tthn tthn " 
im = f EO Pud = dim Lo f EAO, a Gyadr 
t t 


















































noo hy, hn 
=E(fi(t), Oa = E(t), fa(t))u, ae. t€ [0, T]. 
This completes the proof of Lemma ÆTTA. Oo 


We also need the following technical result. 


Lemma 4.15. If p € [1,00], yr € 4, (2; H) and f(-) € LR(Q;L*(0,T; H)), 
then the process 





T 








¢ 





(str - ur - f * s(s—9s(s)ds | F.) (4.64) 


has a càdlàg modification in L&(Q; D([0, T]; H)). 
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Proof: We consider only the case p € [1, oo). Recall that for any A € p( A), 


the Yosida approximation A) = XNAI — A)-1 — AI of A generates a Co-group 
(SX(t)hen on H (e.g., [372]). 
For t € [0, T], put 


tâ 


& SE(S\(T — tyr - | Sys - Df(s)ds | F) (4.65) 














and 


HAEG- | S3 (s)f (s)ds. (4.66) 














It is easy to see that X4(-) = E(S\(T)yr — od SX (s) f (s)ds | F.) is an H- 
valued F-martingale. By Theorem LIM, it enjoys a càdlàg modification in 
L5 (0; D([0, T]; H)), and hence so does the following process 


ct = S,(-t) [x0 4 | Sy (s) (s)ds| 


Here we have used the fact that {.5)(t)}:er is a Co-group on H. We still use 
Gy to stand for its càdlàg modification. 
From (464) and (455), it follows that 


li — G| rrio. i 
Jim Ie Cal 22 (2;L%(0,7;H)) 


< lim [S(T - Jur — S4 — Jur 


A—oo 





Lp (Q; L®(0,T;H)) (4.67) 


T T 

+ jim | j S(s—-)f(s)ds — J Sa (s — -)f(s)ds aTa 

Let us prove the right hand side of (207) equals zero. For this purpose, 
noting that the set of simple functions is dense in L4, (£2; H), we conclude 
that there exists a sequence (y")5,., C LE, (0; H) satisfying the following 
two conditions: 

1) y" = pares og xor (w), where Nm € N, af € H and Qg € Fr with 
(QI V7, to be a partition of 2; and 

2) limm—+oo ly” — yrlzs, (0:8) =0. 
Likewise, since the set of simple adapted processes is dense in LP(Q; L'(0,T; 
H)), there exists a sequence {f}9_, C LE(2; L' (0, T; H)) satisfying the 
following two conditions: 

i) i = xm $5 OP EXO, (w) xterm em y(t), where Lm € N, Mr = N, 


g+1 
o", € H, QM, € Fy with (07,5, being a partition of 2, and 0 = t? < 
ty UP «Up +1 =T; and 
ii) limmo |f" — fz2(0;11(0,7;H)) = 0- 
Now, let us prove that 
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lim [S(T — )yr — SA(T — )yr 


- (4.68) 
iios LP(Q:Lo* (0,T;H)) 


Since (S(t) iso is a Co-semigroup, for any £ > 0, there is an M > 0 such that 
for any m > M, it holds that 





m m E 
ISI" — 9p — S(T — -)y™ — SAT — -)yr SAO — -)y Iu (GL (o,T.H)) < 5 


On the other hand, by the property of Yosida approximations, we deduce that 
for any a € H, it holds that lim)_,.. |S(T — -J)a — SA(T — -)a|rs-(o;r;g) = 9. 
Thus, there is a A = A(m) > 0 such that for any A > A, it holds that 





m m E 
[S(T -Jak S\(T -Jag [L»» (0, H) < ON,’ k= 1, 2,- B Nm, 


which implies that 


IS(T = -)y™ = S(T — JY” l L2(2;L=(0,T;H)) 





Nm 
m m E 
= 5 IS(T — -Jag — S(T — -Jak l Le (omn) < 3" 
k=1 


Therefore, for each m > M, there is a A = A(m) such that when A > A(m), 
it holds that 


S(T —-)yr — S(T — -)yr 





Lg (@;L° (0,T;H)) 
< |S(T' —-)yr — SA (T — )yr — S(T —-)y™ + S(T — "nte Ee (oT 12) 
+|S(T — )y" — SA (T — -)y™ |Le: L= (oT; B) 


S uum 
2.2 ^ 


This gives (468). 
Further, we show that 








=0. (4.69) 
Li (Q;L~ (0,T;H)) 


lim | se artaas— f so - aros 


A—oco 





For any e€ > 0, there is a M* > 0 such that for any m > M*, 


n S(s—-)f(s)ds — a S(s—-)f™(s)ds 





Ly (Q;L®(0,T;H)) 


+ f “Se= i S46 9/" Gs 





LẸ (Q;L®(0,T;H)) 


< 


NI 
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By the property of Yosida approximations again, for any a € H, it holds that 


ia | S(s—ads— f sx SX(s —- Jads| 
L=(0,T;H) — 


Hence, there is a A* = A*(m) > 0 such that for any A > A*, 


T T 
| S(s - Jards- | S5 — OFA] oan 
E 


j= 1,2,- Lm; k = 1,2,- MIS 





< 2J,, max( M^, MZ,- , MP)’ 


'This implies that 


Pd 


Lm M " E 
: 2. oF S(s - Jagyds -f s« Sals = JF ds oan =F 


Therefore, for any m > M* and A > A* = A*(m), we have 


n Suc Ms f S tu cdrtido 


which gives (69). 
By (£61), (268) and (459), we obtain that 





Lp (2;L% (0/T;H)) 





+z =E, 





"- € 
LE (Q; L®(0,T;H)) 2 2 


Jim IC — Glreto;ro (orm) = 9- 
Since ¢) € LE(Q; D([0, T]; H)), we see that ¢ enjoys a cádlág modification in 
LB(Q; D((0, T]; H)). Li 


We have the following well-posedness result for a special case of (ELZU), 
i.e., the linear equation (421), in the sense of transposition solution. 


Theorem 4.16. For any yr € Lf- (Q; H) and f(-) € Lg(0, T; LP (Q; H)), the 
equation (ELZI) admits one and only one transposition solution (y(-), Y (-)) € 
Dg([0, T]; LP (12; H)) x L2(0, T; LP (Q; £2)). Furthermore, 


(y 


b 
= C(lyrlzz. (OH) + IFC )»zaQo,T; zo (958))- 


»YC Idec [0,7]; L» (Q;H)) x L2 (0,T; L» (Q;L2)) 
(4.70) 


Proof: The proof is divided into four steps. 


Step 1. For any t € [0, T], we define a linear functional £ (depend- 
ing on t) on the Banach space Ll(t,T; L*((2; H)) x L2(t,T; L1(02; £9)) x 
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L5- (2; H) as follows: First, for any (v1(-), v2(-),7) € Lg(t, T; L*(0; H)) x 
Lg(0s L?’ (t, Ty £3) x LE, (£5 H), 








I> 














£(v1(-), v2(-), m) 








T 
E(2(T), yr) g — J (2(s), f (s)) yds, (4.71) 


where z(-) € Cg([t, T]; L(f2; H)) solves the equation (E57). By the Holder 
inequality and noting (£59), we see that 


|4(vi (-), v2(-),7)| 


< le(T) |r (em [Yr] (H) + [e(l ort T] Lm lf ILLET; Le; 


<C (luri? con T Kf Obzierizocsm) 
Vte [0,7], 
(4.72) 
where the positive constant C = C(T,A) is independent of t. From (ŒE), 
it follows that Z is a bounded linear functional on Li(t,T; L?(€2; H)) x 
Lg(0; L^(t,T; £2)) x LE (2; H). Since q € [2,00), by (230), it is easy to 
see that LA(Q; L^(t, T; £9)) 2 D2(t, T; L*(£2; £9)). Then, £ is also a bounded 
linear functional on L&(t, T; L4(; H)) x L(t, T; L3(0; £2)) x LE, (2; H). 
Thanks to Theorem E743, there is a triple (y*(-), Y*(-),€') € LẸ (t, T; L^ (Q2; 
H)) x Lg(t, T; L' (0; £2)) x L (2; H) such that 


x [(vi C), v2 C). n) za urbes) L8 CIS £9) xL, (Q;H)? 


























Tq: 
E(«(T) yr), — E | (s(r), f(r)) dr 






































T T 
-E f (vi (7) y (7)) y dr +E f (v2(7), Y*(T)}) cg dr + Efn, 8) ir 


V (vi(), va), n) € Lp(t, T; L*(0; H)) x LEO; L’ (t, T; £2)) x LE (Q; H). 

(4.73) 

It is clear that ¿T = yp. Furthermore, there is a positive constant C = C (T, A), 
independent of t, such that 


I(u* C); Y) £5 | Lge (Tio (03H) x LB GT L9 (£9) x LE, (2;H) 


4.74 

<C (luris. con F IFOlrzer:rrcm)) , VES [0,7]. dc 

Step 2. Note that the function (y'(-), Y'(-)) obtained in Step 1 may de- 

pend on t. In this step, we show the time consistency of (y‘(-), Y'(-)), that is, 

for any tı and tg with 0 € t < tı € T and ae. (7,w) € [t4, T] x £2, it holds 
that 

(y? (ru), Y"? (7,w)) = (yw), Y" (T,w)). (4.75) 


Since the solution z(-) to (E57) depends on t, we denote it by z'(-) when- 
ever there exists a possible confusion. To show (Æ), we fix arbitrarily 
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oC) € Le(ti,T; L4(Q; H)) and «(-) € LE(Q; L?(t1,T; £2)), and choose first 
t= ti, 7 = 0, v(-) = o(-) and v2(-) = ¢(-) in (E57). From (473), we obtain 
that 


























T 
Re^), -E | Gh L0)) nar 


(4.76) 








ES 




















T 
a (s(7), Y^ (7)) podr-. 


tı 


T: 
=E | (o(r),u"()) yar + 


ty 


Then, choose t = t2, n = 0, vi(t,w) = xju,ry(t)e(t,w) and vo(t,u) = 


























Xte,7)(E)s(t,w) in (ELS). It is clear that z?(-) = ey a me From 
the equality (E73), it follows that 
T 
(T) vr) -Ef (0) fuir 
n (4.77) 


























T T 
= f (o(r), y^ (7)) ydr + Bf (sr), Y^ (7) podr. 


Combining (æ) and (EZA), we obtain that 


























T T 
Bf (oae) -ydr =E | GO Y) YC) gdr, 


Vo() € Let, T; L99; H)), «() € LECO; L? (ti, T; £3)). 


This yields the desired equality (ZZ). 
Put 


y(t,w) = y (to), Y(t,o) 2Y9?(tu), V(t,w) € [0,7] x 9. (4.78) 
From (£5), it follows that 
(y (T, w), ¥*(7,w)) = (y(r, w), ¥(7,w)), a.e. (T,w) e [t, T] x Q. (4.79) 


Combining (E73) and (ZY), we end up with 


























T 
E(«(T) yr), — E f (z(7), f(r)) dr 



































T 
= En, £) y + e f (vi(T) y(T)) udr + J (va (7), Y (7)) podr, 


V (v1(), v2 (),m) € Lilt, T; L* (0; H)) x LECO; L^ (t, T; £2)) x LS, (Q; H). 
(4.80) 





Step 3. We show in this step that € has a càdlàg modification in the 
space L5(£2; D([0, T]; H)). 
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We claim that, for each t € [0, T], 














E(StT — tur — i  S(s 0 ()ds |i) =e, as  — (480) 


To prove this, we note that for any 7 € L3- (Q; H), vı = 0 and v2 = 0, the 
corresponding solution to (257) is given by z(s) = S*(s — t)m for s € [t, T]. 
Hence, by (ÆU), we obtain that 






































T 
E(S"(T — ty yr) - Eln, £n = f (S*(s — t)n, f(s)),ds. (4.82) 
Noting that 


E(S"(T — t) yr) y = E(n, S(T — t)yr) y = E(n, E(S(T — t)yr | Fe))y 


and 






























































i f 66 omatus = a(n f S(s—t)f(s)ds) 


= En, «(f s - nfi 


by (EL82), we conclude that, for all n € L$, (9; H), 























n), 




















En, e(sqr — t)yr — [ S(s—t)f(s)ds | Fi) = com =0. (4.83) 


Clearly, (81) follows from (283) immediately. 

Since the process E(S(T — -)yr — JE S(s — )f(s)ds | F.) has a càdlàg 
modification in LE(2; D([0, T]; H)) C Ds([0, T]; LP (2; H)), by Lemma EIS, 
we deduce that so does £'. 














Step 4. In this step, we show that, for a.e. t € [0, T], 
& = y(t), a.s. (4.84) 


Fix any y € LS, (2; H). Choosing t = t2, v(-) = 0, ve(-) = 0 and 7 = 
(ti — t2)y in (57), utilizing (Æ80), we obtain that 


E(S" (T — t2)((ti — t2)y) yr) y — EC (ti — t2)7,€7) 


T 
-E | (S*( — ta)((tr — t2)7), f(7)) yr 


t2 


























(4.85) 














Choosing t = t2, v1(r,w) = Xita] (T) (w), v2(-) = 0 and 7 = 0 in (E57), 
utilizing (Æ80) again, we find that 
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N [ S"(T — 8)(X{te,t1 (8) 1) ds, wm), 














=E [ ( 1 S*(r — s)yds, f(r)) dr 


























+E ra (s* (T-t) [ S* (tı — s)yds, f(r) ar +E [ etur. 



















































































ti 2 t2 
(4.86) 
From (4235) and (286), we find that 
E(y, £?) 
1 " 
=e | EGathae e EG - yan) 
1-7 42 Jte 
lod 
“aoe j, 90 -Doteau( err) , 
T 1 ty T 
-E *(r—t d E *(r— d 
[80 - eto) nie cR [Cf sm ruis 16) t 


1 7 T * H * 
Wc Ji (s e-i f S (tı — syyds, f(r) dr. 
(4.87) 


Now we analyze the terms in the right hand side of (ÆJ) one by one. First, 
it is easy to show that 
































1 ty zx 
, eo z q (Q: 
LX [ ( 96 s)yds, f(r)} dr 0, Ya e Li. (0H). 
























































(4.88) 
Further, 
T 
Ig cg EC, 90 ossa an 07) y 
D zo. (4.89) 
= jim, ie xf S (T — r)ydr, yr) 
= E(S"(T — t2)y, Vr) g- 
Utilizing the semigroup property of {S*(t)}i50, we have 
li l ef (s wf s )nds, f(r)) d 
im T= —s)yds, f(T T 
1412240 tı — t2 tı i t2 5 yas, H 
(4.90) 














T 
- f (S*(r — ta), f(7)) dr. 


t2 


From (E87), (88), (£89) and (£90), we arrive at 
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1 ns a 
„im gig | EowCee-EQi9), (491) 


for arbitrary t € [0, T) and y € Lr (Q; H). 
By Lemma E14, we can find a monotonic sequence {hn}; of positive 
numbers with lim An = 0, such that 
n-—oo 























1 tathn 
lim =f E(y, y(7T)) udr = E(y, y(t2))g, a.e. t2 € [0,T). (4.92) 
t2 





By (ÆJ) and (£92), we arrive at 




















E(y,£?)n = E(y,y(t2)u, ae. ta € [0, T], (4.93) 








which implies (E84) immediately (by choosing y = €' — y(t2)). 

Now, by (2284) and recalling that ¿t has a càdlàg modification, we see that 
there is a cadlag H-valued process j(-) such that y(-) = 9(-) in [0, T] x 2 ae. It 
is easy to check that (g(-), Y (-)) is a transposition solution to the equation 
(IL2I). To simplify the notation, we still use y (instead of j) to denote the 
first component of this solution. Clearly, (y(-), Y (-)) € Dr((0, T]; LP (2; H)) x 
L£(0, T; L” (Q; £9)) and satisfies (ILZU). Also, the uniqueness of the transpo- 
sition solution to (ÆZI) is obvious. o 


Remark 4.17. In the proof of Theorem ÆIÐ, we need to use the assumption 
p € (1,2] to guarantee that L(t, T; L9 (9; £9)) C LA(Q; L? (t, T; £2)). How to 
drop this restrictive assumption on p is an open problem. 


Similar to Theorem IÐ, we have the following result, in which the as- 
sumption for f(-) is slightly relaxed to be f(-) € L?(Q; L1(0, T; H)) while a 
stronger requirement on S(-) is imposed. 


Theorem 4.18. Let S(-) be a generalized contractive Co-semigroup. Then, 
for any yr € LE, (0; H) and f(-) € LE(£2; L' (0, T; H)), the equation (E21) 
admits one and only one transposition solution (y(-), Y (-)) € Dr([0, T]; L^ (£2; 
H)) x L2(0, T; L (02; £9)). Furthermore, 


ly), YC) le ((0,7];£2 (2:17) x L2(0,T;12 (2:9) 
<C lurr (0:0) us Hop 


Proof: When S(.) is a generalized contractive Co-semigroup, by The- 
orems EZI and EIA, the equation (ÆA) admits a unique mild solution 
z € Li(Q; C([t, T]; H)), and 


2| rg cose eram) 
: (4.94) 
< C (Inlzs. (as) + [vilro eTa) + |v2|n9(2,02(t,7;£8)))- 
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By (ÆJ) and proceeding as in the proof of Theorem ELIG, we can prove 
Theorem (The only difference is that in (LLZ2) we use (£94) instead of 
(IL5N)), and hence we omit the details. LH 


Based on Theorem ELIG, we have the following well-posedness result for 
(420) in the sense of transposition solution. 


Theorem 4.19. Let Condition H] hold and F(-,0,0) € Li1(0, T; L"(€2; H)). 
Then, for any yr € LE. (Q; H), the equation (E20) admits one and only 
one transposition solution (y(-), Y (-)) € De([0, T]; L?(Q; H)) x L2(0, T; L?(Q; 
L3)). Furthermore, 


(y Js ru ))Ipe([o,T] L2 (9:8)) x L2 (0,7; 12 (2509) 


p 
<C(\yr|zz, (OH) + |F(-, 0, 0)|23(0,7;n°(92;H)))- 


(4.95) 


Proof: We proceed as that in Step 2 in the proof of Theorem HLIU. 
Fix any Tj € (0,7). For any fixed (z(-),Z(-)) € De([I3, T]; LP(2; H)) x 
L£(I3, T; L?(Q;£3)), by Condition HI and F(-,0,0) € L1(0, T; LP (Q; H)), 
it is easy to see that F(,2(), Z(-)) € DEI, T; LP(£2; H)). Consider the fol- 
lowing equation 


l dy(t) = — Ay(t)dt + F(t, z(t), Z(t))dt + Y()aW (t), t€ [n, T), 
(4.96) 


y(T) = yr. 


By Theorem E16, the equation (LLU8) admits a unique transposition solu- 
tion (y), Y (-)) € d L?(Q; H)) x CERT TS LP (Q; £9)). This defines 
a map J from Dr([I1, T]; L"(0; H)) x L2(13, T; L"(; C)) into itself by 
(26), ZEO) 9 (C) Y C». 


We claim that, for T, being sufficiently close to T, 


IG Z) - JG. Zl pg er, rao (ast) x LTT; LP (2:29) 
1 P 
€ gl Z)- (2, Z)| ptr, rro co ry) ET, mto (0c 


V(z,Z), (&Z) € De([n, T]; (0; H)) x L2(T,,T; LP (Q; £3). 


(4.97) 


To show (ETD, put fC) = F(-,2(), 20) — FC 20), Z()) and (40), PO) = 
J (z, Z) — J (2, Z). Then, (9(-), Y (-)) satisfies 


l dij(t) = —Ag(t)dt + f(t)dt -- Y(t)aW(t, — te[n.T), (4.98) 


$(T) = 


Applying the estimate (Æ) respectively to the equations (298) and (E), 
we find that 
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(GC) FOI Dera mizoco yx £3 (Ta Tto (0:£2) 
S C[F(2(),2()) =F G20); ZOIL, T;L2(0;H)) (4.99) 
€ C(L Olm r + H2) 

x|(z()=2(), Z()-— Z())Ip«tryTlzo (0:8) LT T; LP (23£9)) 


and 


(u Yo D| De (T Tl z2(9:8)) x LCD, T;L (2;£3)) 

<C(\yrlzz, „(2;H) + IF(,2(-), ZO) Ion mio (o) 

< C(lyrlzs... (9:2 + |F(-, 0, 0)| rz err m2 (9:2) (4.100) 
C (Lx C)| px enm) + |Lo(-)| 227,79) 


x|(zC), Z (J) | DETT]; Lr (2;H))x L2 (T1, T; Le (9:9) 
Let us choose T1 such that 


E 


C (Ua Olr m)  IE2()0zoen m) € 2 (4.101) 


Then, by (£99), we get (£97). This implies that the map 7 is contractive. 
Hence, it admits a unique fixed point, which is a transposition solution to 
(EL20) on [71, T]. Moreover, by (ELTUU)- (ILTUT), it follows that 


(yC), Y (J)In«qn, T];L» (Q;H)) x L2 (Ty, T;L? (Q;£9)) 


( 
< C(lyrlzs. ( (mm) HF C.0,0) rito; zo (0:8))- 


(4.102) 


Repeating the above argument, we obtain the existence of transposition so- 
lutions to (420). The uniqueness and the estimate (2295) follow from the 
estimate (4102). 

Proceeding exactly as that in the proof of Theorem EL IJ, based on Theorem 
LIA, one can show the following well-posedness result for (220). 


Theorem 4.20. Let Condition 4.7] hold, S(-) be a generalized contractive Co- 
semigroup and F(-,0,0) € LE(f2; L' (0, T; H)). Then, for any yr € Li (Q; H), 
the equation (EL2Ul) admits one and only one transposition solution Ge LYQ) 
€ De([0, T]; L?(Q; H)) x L2(0, T; L^(62; C9)). Furthermore, 


Iu C): Y CI peto zo (9:1) x z2(0,T:12 (2:9) 

< C(lvrlzo.. tox H0, 0)|22(.2;11(0,7;H))): 

Remark 4.21. At the very beginning of this chapter, we assume that H is a 
separable Hilbert space. Similarly to [242] (in which V is assumed to be R), 


we believe that the separability assumption on H can be dropped but this 
remains to be done. 
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4.4 The Case of Natural Filtration Revisited 


In this section, we assume that F is the natural filtration condition, and revisit 
the equation (420), and its special case, the equation (ÆZI), by means of the 
transposition method. 

We begin with the following result. 


Proposition 4.22. Let Condition Z] hold and F(-,0,0) € L5 (0, T; L?(€2; H)). 
Then, for each yr € L*-.. (2; H), the corresponding mild solution (y(-), Y (-)) € 
L2(0; C([0, T]; H)) x D2(0, T; £3) to the equation (E20) is also a transposition 
solution to the same equation. 


Proof: By Theorem TY, for each A € p(A) n p(A*), the equation (E58) 
admits a unique strong solution (y)(-),Y(-)) € L2(0;C([0,T]; D(A))) x 
L2(0, T; £9), and 


Jim Ia), Ya) = GC) Y C)lzgtaseqoinyxza(uncs — 0. (4.103) 


On the other hand, by Corollary EZA, for any t € [0, T], v4(-) € L2(Q; L1 (t, T5 
H)), vo(-) € Dg (t, T; £9) and n € L} (2; H), the following equation 


dz, = (A*zy + R(A)*v)ds + R(A)*vodW (s) in (t, T], (4.104) 
z(t) = RO)" | 
admits a unique strong solution z)(-) € Ce([t, T]; L?(; D(A*))), and 
Jim [zi €) — z0)lesqurizacosnm) = 0; (4.105) 


where z(-) solves (457) in the sense of mild solution. 
Applying Itó's formula to ( za (-), yA(-) ) y and noting the equations (£104) 
and (E50), we obtain that 


























T 
£z (T), R(A)yr) y - E I (Ga (8), RO) F(s, ya (5), Ya (8))) ds 


























p 
= E(R(A)"n u(t), +E 1 moune (4.106) 














T 
+e f (RO) va (5), Ya (5)) pods. 


Letting A — oo in (LLIUG), and noting (2103) and (ELIUS), we find that 
(y(-), Y (-)) satisfies (£59), and therefore it is a transposition solution to the 
equation (220). o 


We have the following result for the linear equation (ÆZD). 
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Theorem 4.23. For any p € (1,2), yr € LZ. (0; H) and f(-) € L}Ł(0,T; 
L?(Q;H)) (resp. f(-) € LR(Q;L1(0,T; H)) and S(-) is a generalized contrac- 
tive Cg-semigroup), the equation (ECZTI) admits one and only one mild solution 
(y(-), Y ()) € LE(Q; C([0, T]; H)) x D2(0, T; LP((2; £9)). Furthermore, 


(y(- 
= C(lyrlza. (2H) T If (-)lza(0,7,22 (0:2) (4.107) 


^Y) Ir? (Q;C([0,T] H)) x L2(0,T; L7 (2:9) 


(resp. C(lyrlzs. (ast) + IF Ce zecos zio, 2))- 


Proof: We consider only the case that f(-) € L1(0, T; L” (Q; H)). 

By Theorem E16, the equation (£21) admits one and only one transposi- 
tion solution (y(-), Y (-)) € De([0, T]; Le (Q; H)) x L2(0, T; L” (Q; C9)), and it 
satisfies (ILTU7]). It remains to show that (y(-), Y (-)) is also a mild solution to 

We choose two sequences (yj), C LÆ, (Q;H) and (f*());9, 
Li(0,T; L°(2; H)) such that 


Jum lys — yr|zs. ( (2;H) = 9, Jim |^) — fOlzitomzo cour) — 0. (4.108) 


Since LX (2; H) C L4 (9; H) and Ly(0,T; L® (2; H)) C L$(0, T; L?(Q; H)), 
by Theorem ELTU, the following equation 
uei = — Ay" (t)dt + f*(t)dt + Y"(t)aW(t) in [0, T), 
y*(T) = yi 


admits a unique mild solution (y*(-), Y^(-)) € L2(0; C([0, T]; H)) x L2(0, T; 
LÌ). Hence, for any t € [0, T], 


(4.109) 


i 
y (t)= S(T — yk p- [se or s)ds mus 


T 
-f S(s — t)Y*(s)aW (s), a.s. 


By Proposition ÆZA, (yF(-), Y*(-)) is also a transposition solution to 
(2109). Then, applying Thesreri ELIG to the following equation: 


d(y(t) — y*(t)) = —A(w(t) — y*(t)) dt + (F(t) — f^(t))at 
+(Y(t)-Y*(t))dW(t) in [0, T), 
y(T) - y (T) = vr - vi. 
we conclude that 


k k 
la^ 6 Y ^C) Y) | De ((0,7]4£° cosy) rà (o Ts Eo (0:09) 
(4.111) 


Ec (lui = Vrlzs, (2H) +I- fOlziorastour)) . 
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Taking k > oo in (ÆU), and noting (ELIIT) and (ELIUS), we find that 
(y(-), Y (-)) verifies (224), and hence it is a mild solution to (£21). Noting 
also that (y)? , is a Cauchy sequence in LE(2;C((0, T]; H)), we then obtain 
(EIU). L1 


By Theorem and the Banach fixed point theorem, similar to Theorem 
ETÀ, it is easy to derive the following result for the equation (220) (Hence we 
omit the proof). 


Theorem 4.24. Let Condition -J hold and p € (1,2]. Assume that F(-, 0,0) 
€ LE(0, T; LP(2; H)) (resp. F(-,0,0) € LE(£2; L+ (0, T; H)) and S(-) is a gen- 
eralized contractive Co-semigroup). Then, for any yr € L (2; H), the e- 
quation (ELZU) admits a unique mild solution (y(-), Y (-)) € LR(2;C((0, T]; 
H)) x L2(0, T; L"(€2; £9)), which is also a transposition solution to the same 
equation. Furthermore, 


I(uC) Y CJ)lzecoseqo;m m)» £3 (0,T; 57 (9:c9)) 
< C (lurre (ast) +|F(,0, 0)|11(0,T;L2(92;1))) (4.112) 


(resp. C(lurlzz. (0: + |F(-,0, 0) reco: (0,7:2)))- 


4.5 Notes and Comments 


'The theory of backward stochastic evolution equations remains a new and 
relatively unexplored area. This chapter only gives a very short introduction 
to this important topic. 

People have studied two different kinds of backward stochastic differen- 
tial/evolution equations in the literature. The main difference between them 
is whether their solutions are adapted. We refer the readers to [L74, 266] for 
the classical works for backward stochastic differential equations with non- 
adapted solutions. In this chapter, we only consider backward stochastic d- 
ifferential/evolution equations with adapted solutions, which are quite natu- 
rally in the study of stochastic control problems. Linear backward stochastic 
differential equation with adapted solutions was introduced in [HT], for the 
purpose of studying the Pontryagin-type maximum principle for stochastic 
optimal control problems. The well-posedness of nonlinear backward stochas- 
tic differential equations was established in ZA]. A little later, this sort of 
nonlinear equations was also independently introduced in [RT] for the study 
of the so-called recursive utility in finance. Detailed introduction to backward 
stochastic differential equations can be found in BA, 272, B22, BRT]. 

In order to use the Martingale Representation Theorem, a key assumption 
in the theory of backward stochastic differential equations is to assume that 
the filtration under consideration is generated by the underlying Brownian 
motion. This restriction was dropped in several works (e.g., (203, ZÆ) by 
generalizing the definition of solutions. 
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As far as we know, backward stochastic evolution equation was first in- 
troduced in [26] to derive maximum principles for some stochastic distributed 
parameter control systems (See also [I48, L49, BIJ) and so on for some ear- 
ly results in this respect). Unlike stochastic evolution equations or backward 
stochastic differential equation (i.e., backward stochastic evolution equations 
in finite dimensions), there are no published books addressing exclusively to 
backward stochastic evolution equations (though some results on this topic 
can be found in the monograph [242]). 

The main result in Section ÆJ is due to [271]. The results presented in 
Section are some small modification of that from B, 148, II49, 258, 258). 
Sections EL2HLZl are some extensions of the related results appeared in [241], 
242, 244], obtained by means of our stochastic transposition method. 

Compared to backward stochastic differential equations, there are many 
things for backward stochastic evolution equations which remain to be done, 
for example: 


e In finite dimensions, people also studied forward-backward stochastic dif- 
ferential equations ((251]). It would be quite interesting to study their in- 
finite dimensional counterpart, i.e., forward-backward stochastic evolution 
equations. It seems that there are almost no publications in this direction 
(See [84] for the only one reference that we know). 

e In the setting of finite dimensions, people also studied backward stochas- 
tic differential equations driven by G-Brownian motions ([L47 276, 277, 
forward-backward doubly stochastic differential equations (|Z78]) and back- 
ward stochastic Volterra integral equations ([B67, B68]). It would be quite 
interesting to study their infinite dimensional counterpart, i.e., backward 
stochastic evolution equations driven by G-Brownian motions, forward- 
backward doubly stochastic evolution equations and backward stochastic 
Volterra integral equation in infinite dimensions. As far as we know, there 
exists no publication in this respect. 

e It is quite interesting to study backward stochastic evolution equations 
driven by general martingales but this seems far from well-understood 
(See [344] for a result in this respect). 

e As mentioned before, besides applications in control problems, backward 
(or more generally, forward-backward) stochastic differential equations are 
also widely used in financial mathematics, stochastic analysis, partial d- 
ifferential equations, etc. (e.g., [bG, [73, RG, Z5T, 274), BZT). It is quite in- 
teresting to consider similar applications of backward stochastic evolution 
equations but it seems that almost nothing has been done, yet. 

e It is almost blank about the numerical analysis on backward stochastic 
evolution equations. As far as we know, the earliest work in this respect 
(for backward stochastic parabolic differential equations) is the Ph D thesis 
[324] by Y. Wang (See [84, 283, B45, B46) for a few pioneer works). 
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Several more comments on our stochastic transposition method and trans- 


position solutions to the backward stochastic evolution equation (420) are as 
follows: 


'The usual duality analysis is contained in the definition of transposition 
solutions, and therefore, one does not need to utilize any deep result in 
martingale theory to deduce this sort of duality relationship any more. 
Moreover, when H — V — R, it is easy to deduce a comparison theorem 
(See BÆI, Theorem 5.1]) for transposition solutions to (420) by using 
almost the same method as that in the case of natural filtration ([&G]). 
It is notable that, by means of this comparison theorem, some interesting 
new results were obtained in a recent paper [854]. 

As we shall see in Sections and in Chapter [T2, by our stochastic 
transposition method, it is even easier to establish Pontryagin-type max- 
imum principles for stochastic optimal control problems (for both finite 
and infinite dimensions) than to solve the same problem with the natural 
filtration (B73, B|) because, again, the desired duality analysis is already 
contained in the definition of transposition solution. 

Our method does NOT need to use the Martingale Representation Theo- 
rem, and therefore we can study the problem with a general filtration. 
Because of this, as we have done in [242, 248] (See also Chapters 
and [L3), the stochastic transposition method can be employed to solve 
some very difficult well-posedness problems for operator-valued backward 
stochastic evolution equations. Note that, when dealing with backward 
stochastic evolution equations with operator-valued unknowns, as far as 
we know, there exists no suitable Martingale Representation Theorem (for 
the Z(H)-valued martingale) even if F is the natural filtration. 

By our method, when p — 2, the correction part Y (-) in the transposition 
solution to (LLZU) can be obtained by the classical Riesz Representation 
Theorem for Hilbert spaces, and therefore, as mentioned in [241], Remark 
3.2], one can even give a numerical scheme (at least conceptually) for Y (-) 
although the detailed analysis is beyond the scope of this book. Indeed, 
let {Hm }90_, be a sequence of subspaces of L2(0, T; £2) such that for any 
g(-) € L2(0, T; C9), there exists a sequence {g,,(-)}°°_, satisfying that 


dm(-) € Hm and lim. lim — elige = 0 
Now, for any fixed m € N, choosing t = 0, 7 = 0, vi(-) = 0 and v2(-) = 


Um(-) € Hm in (IL) (and denote by z,,(-) the corresponding solution). 
From (E), we see that 






































T T 
E(z, (T), yr) jg — E I (2m(7), f(T) ydr =E n (om (T), Y (7)) gdr. 


(4.113) 
On the other hand, using the same argument to obtain Y (-) (by Riesz’s 
Representation Theorem), we can find Ym(-) € Hm such that 
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A 





























T 
f (Um (7), Ym (7)) co dT. 
(4.114) 
From (ETI3)-(E-IT4), it follows that Y, (-) is the orthogonal projection of 
Y(-) to Hm. By the definition of Hm, we find that 


VA 
E tm(T), Ur) — e f (im(1), f(r))gdr = 


,im Ym) — Y C)lzzto.r;eg) = 0- 
Therefore, one may obtain a “good” approximation of Y(-) if one can 
choose a suitable sequence (H,,]2?., such that Ym(-) (say, belongs to a 
finite dimensional space) can be computed efficiently and that Ym (-) con- 
verges to Y (-) in L2(0, T; £9) in some sense. Whenever Y (-) is computed, 
it seems that another part y(-) in the transposition solution to (420) can 
be obtained (numerically) even easier. On the other hand, similar to the 
classical finite element method solving deterministic partial differential 
equations, our stochastic transposition method leads naturally numeri- 
cal schemes to solve both vector-valued and operator-valued backward 
stochastic evolution equations. Indeed, our Definition can be viewed 
as a variational formulation of the equation (220), even if the underly- 
ing filtration F is the natural one. These ideas were partially adopted in 
the works [342] and [69, 59, BA], which gave approximate solutions to 
backward stochastic evolution equations and forward-backward stochastic 
evolution equations (both in finite dimensions) based on our stochastic 
transposition method. We expect that the method in [69, 159, B41, B42] 
may be extended to the setting of infinite dimensions but a careful study 
will be needed. 

Clearly, in some sense, the transposition solution (y(-), Y (-)) to the back- 
ward stochastic evolution equation (4.20) is, in spirit, very close to the 
distribution solution to partial differential equations. It is then very nat- 
ural to study the further regularity of (y(-), Y (-)) but this is beyond the 
scope of this book. 


f 


Check for 
updates 
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Control Problems for Stochastic Distributed 
Parameter Systems 


In this chapter, we shall present several typical controlled stochastic evolu- 
tion equations, including a new refined controlled stochastic wave equation 
in particular. Then, we shall give a quite general formulation of some typical 
control problems, such as controllability/observability problems and optimal 
control problems for stochastic distributed parameter systems. 


5.1 An Example of Controlled Stochastic Differential 
Equations 


Throughout this section and the next one, T > 0, (Q,.F, F,P) (with F = 
{F+}1e[0,7)) is a fixed filtered probability space (satisfying the usual condition), 
on which a one dimensional standard Brownian motion W(-) (unless other 
stated) is defined. 

Before introducing control problems for stochastic distributed parameter 
systems, we first present some control problems for a linear stochastic differ- 
ential equation appeared in the financial market (e.g., [H7T]). 

Consider a market where a bond and m stocks are traded continuously, 
where n € N. The price process Po(t) of the bond is governed by the following 
ordinary differential equation: 


us = r(t)Po(t)dt in [0, T], 


5.1 
Po (0) = po > 0, m 


where r(t) > 0 is called the interest rate of the bond, po is its initial price. 
The price processes P} (t), - - - P, (t) of the stocks satisfy the following stochastic 
differential equation: 


o = a;(t) P;(t)dt + b;(t) P;(t)aW (t) in [0,1], pa 
5.2 

P;(0) = p; > 0, 
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where, a; : [0, T] x (2 — R is called the appreciation rate, and b; : [0, T] x 2 > 
R is called the volatility of the j-th stock, p; is its initial price, j = 1,--- ,n. 
All aj and b; are assumed to be F-adapted. The diffusion term in (E2) reflects 
the fluctuation of the stock prices. 

Denote by x(t) the total wealth of an investor at time t > 0. Suppose that 
he/she holds N;(t) shares of the j-th asset (j = 0,1,--- ,n) at time t. Clearly, 


- Y^ NP. t 2 0. (5.3) 
j=0 


Assume that the trading of shares and the payment of dividends (at the rate 
I4 (£) per unit time and per unit of money invested in the j-th stock) takes 
place continuously, while for the bond, the rate uo(t) = 0. Write c(t) for the 
rate of withdrawal for consumption. Then, with time increment At, the change 
of this investor's total wealth is given by 


a(t + At) — x(t) 


-Y N(0(B A ) + Lato aaa T 
j=0 





Put " 
u;(t EN OPE), | j2012---,n 


which stands for the market value of the investor's wealth in the j-th 
bond/stock. By letting At — 0, we obtain that 


dx(t) = »» N;(t)dP;(t) + 3 ju; (t).N;(t)P; (t)dt — c(t)dt 
j-0 ja 
- [be (t)N n (a;(t) + n; (t)) N;(t) P; (t) -«(t) dt 
+ - N;(t) P; (t)b; (t)dW (t) 
= [rto ESSC ) + uj(t) — r(t))u;(t) — «(t dt 
di Y b; (t)u;(t)dW (1). 


Hence, x(-) satisfies the following stochastic differential equation: 
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de(t) = [r(t)e Ord aj(t) + (t) — r(t))uj(t) — «(t| at 


x(0) = T0, 
where Zo represents the investor’s initial wealth. 


Remark 5.1. For simplicity, we assume that the investor can do short-selling 
and borrow money. In this case, each u;(-) can be negative. When u;(t) < 0 
(for some j = 1,2,--- ,n), the investor is short-selling the j-th stock; when 
uo(t) < 0, the investor borrows money of the amount |uo(t)| with an interest 
rate r(t). On the other hand, it is clear that c(-) 7 0. 


The investor can change the "allocation" of his/her wealth in these assets 
by changing u(-) = (uo(-),u1(-),--- ,Un(-))' and/or c(-), both of which can 
be viewed as controls. 

Clearly, there is an implicit constraint on the portfolio u(-) due to the 
stochastic environment, that is, at any time the investor can only utilize the 
past information. Therefore, the controls must be nonanticipative, i.e., adapt- 
ed to the filtration F. 

For a given initial wealth zo > 0 and an expected return rp € L4 (9), a 
natural objective of the investor is to choose an investment portfolio u(-) and 
a consumption plan c(-) such that 


z(T)-zmp, as. (5.6) 


This is typically a controllability problem. Usually, the requirement (EW) is 
too strong, particularly in the stochastic setting. À more realistic requirement 
is to relax (EH) as follows: 


x(T)€ A, as, (5.7) 


for some given subset A € L7. ((2). This is also a sort of controllability prob- 
lem. 

On the other hand, given an initial wealth xg > 0, in order to prohib- 
it bankruptcy and guarantee a rewarding investment, the investor needs to 
choose u(-) and c(-) so that 


a(t)>0, Vtel0,T], as, (5.8) 











Ea(T) > 6x9, as. (5.9) 





for some given 0 > 1, and maximizes the stream of discounted utility: 














T 
J(u(),«)) = E( f eNo(c(t))dt+eTh(x(T))), (5-10) 
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where y > 0 is the discount rate, y(-) is the instantaneous utility from con- 
sumption and A(-) is the utility that comes from bequests. This is typically an 
optimal control problem. Obviously, in order that this optimal control prob- 
lem makes sense, one needs the nonempty-ness of the set of all u(-) and c(-) 
so that both (EX) and (&Y) hold and that the integration in (£10) is mean- 
ingful. Such a nonempty-ness condition can be viewed also as a controllability 
problem. 
In summary, the above investment problem has the following features: 


(1) The system is governed by a stochastic evolution equation; 

(2) There are usually alternative decisions that can affect the dynamics of the 

system; 

(3) The aim is to drive the solutions to the system to a given state (in some 

sense) by selecting a nonanticipative decision; 

(4) There are some constraints that the decisions and/or the state are subject 

to; 

(5) There exists a criterion which measures the performance of the decision- 
s, and the goal is to optimize (maximize or minimize) the criterion by 
selecting a nonanticipative decision among the ones satisfying all the con- 
straints. 





In the next section, we shall present some control problems governed by 
stochastic evolution equations in infinite dimensions. 


5.2 Control Systems Governed by Stochastic Partial 
Differential Equations 


Generally speaking, any ordinary/partial differential equation can be regarded 
as a stochastic ordinary/partial differential equation provided that its coeffi- 
cients, forcing terms, initial and boundary conditions, or at least one of them 
is random. The terminology “stochastic partial differential equation" is a little 
misused, which may mean different types of equations in different places. The 
analysis of equations with random coefficients differs dramatically from that 
of equations with random noises. In this book, we focus on the latter ones. 

'The study of stochastic partial differential equations was motivated by two 
aspects: 


e One is due to the rapid recent development of stochastic analysis. The 
topic of stochastic partial differential equations is an interdisciplinary area 
involved both stochastic processes (random fields) and partial differential 
equations, which has quickly become a discipline in itself. In the last two 
decades, stochastic partial differential equations have been one of the most 
active areas in stochastic analysis. 

e Another is the requirement from some branches of sciences. In many phe- 
nomena in physics, biology, economics and Control Theory (including filter 
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theory in particular), stochastic effects play a central role. Thus, stochastic 
corrections to the deterministic models are indispensably needed. These 
backgrounds have been influencing the development of stochastic partial 
differential equations remarkably. 


In this section, we shall present some physical/biological models described 
by stochastic partial differential equations, including particularly the deriva- 
tion of a refined stochastic wave equation in one space dimension, moti- 
vated by the study of some control problems. The readers are referred to 
(20, 96), 145), I, 69, C, 2571, 290, B16, 832] for typical references on sys- 
tems governed by stochastic equations in finite/infinite dimensions. 


Example 5.2. Stochastic parabolic equations 
The following equation was introduced to describe the evolution of the 
density of a bacteria population (e.g., [71]): 


dy = vdz,ydt + o /ydW (t) in (0, T) x (0, L), 
Yz =0 on (0, T) x (0, L), (5.11) 
y(0) = Yo in (0, L), 


where v > 0, a > 0 and L > 0 are given constants, and yo € L?(0, L). The 
derivation of (6-11) is as follows: 

Suppose that such a bacteria population is distributed in the interval [0, L]. 
Denote by y(t, x) the density of this population at time t € [0, T] and position 
x € [0, L]. If there is no large-scale migration, the variation of the density is 
governed by the following 


dy(t, x) x: Vysa (t, x)dt + d£(t, x,y), (5.12) 


where VYz2(t,2) describes the population's diffusion from the high density 
place to the low one, while £(t,x,y) is a random perturbation caused by 
lots of small independent random disturbances. Suppose that the random 
perturbation É£(t,x,y) at time t and position x can be approximated by a 
Gaussian stochastic process whose variance Var € is monotone w.r.t. y. When 
L is small, which is usual for the study of bacteria, we may assume that 
€ is independent of x. Further, when y is small, the variance of € can be 
approximated by o?y, where o? is the derivative of Var € at y = 0. Under 
these assumptions, it follows that 


d£(t, x, y) = a,/ydW (t). (5.13) 


Combining (E-T2) and (ECL3), we arrive at the first equation of (6). If there 
is no bacteria entering or leaving [0, L] from its boundary, we have y; (t,0) = 
yz (t, 1) = 0. According to these, we obtain the second equation of (B11). 

To control the population's density, people can put in and/or draw out 
some species. Under such sort of actions, the equation (D.II) becomes the 
following controlled stochastic parabolic equation: 
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dy = (vOsíy + u)dt + (ayy + v)aW (t) in (0, T) x (0, L), 
Us —0 on (0, T) x (0, L}, (5.14) 
y(0) — vo in (0, L), 
where u and v denote the way of putting in and/or drawing out species. 
The following equation has been proposed in [B35] to study the propagation 
of an electric potential in a neuron: 
dy = (vOssy — y)dt + g(y)dW(t) in (0, T) x (0, L), 
Ye = 0 on (0, T) x (0, L), (5.15) 
y(0) = yo in (0, L), 


in which g(-) is a suitable operator-valued function, and {W(t)}iso0 is a Q- 
Brownian motion. To control the electric potential, one puts some charge in 
the system. In this way, the equation (6.15) becomes a controlled stochastic 
parabolic equation as follows: 


dy = (vO;y — y + u)dt + (g(y) + v)dW(t) in (0, T) x (0, L), 
Us — 0 on (0,T) x(0,L), | (5.16) 
y(0) = yo in (0, L). 


where u and v stand for the way of putting charges. 

Similarly to Section EJ, one may pose the controllability and optimal 
control problems for (ELI) and/or (218) but we omit the details here. 

Some other models governed by stochastic parabolic equations can be 
found in [68, 856], for example. 





Example 5.3. A refined stochastic wave equation 
To study the vibration of thin string/membrane perturbed by the random 
force, people introduced the following stochastic wave equation (e.g. [LT5]): 


dy, = Aydt + a(t)ydW(t) in (0,T) x G, 
y —0 on (0, T) x 0G, (5.17) 
y(0) = yo, w(0) = yı in G. 


Here G C R™ (m € N) is a bounded domain, a(-) is a suitable function and 
(yo, y1) € Ht (G) x L?(G). Let us recall below a derivation of (EIA) for m = 1 
by studying the motion of a DNA molecule in a fluid (e.g., [I159, BOO). 

Compared with its length, the diameter of such a DNA molecule is very 
small, and therefore, it can be viewed as a thin and long elastic string. One can 
describe its position by using an IR?-valued function y = (yi, ys, ys) defined 
on [0, L] x [0, +00) for some L > 0. Usually, a DNA molecule floats in a fluid. 
Thus, it is always struck by the fluid molecules, just as a particle of pollen 
floating in a fluid. 
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Let the mass of this string per unit length be equal to 1. The acceleration 
at position x € [0, L] along the string at time t € [0, +00) is yu(t, x). There 
are mainly four kinds of forces acting on the string: the elastic force F} (t, x), 
the friction F2(t, x) due to viscosity of the fluid, the impact force F3(t, x) from 
the flowing of the fluid and the random impulse F4(t, x) from the impacts of 
the fluid molecules. By Newton's second law, it follows that 


Y(t, x) = FA(t, x) + Fo(t, x) + F3(t, x) + Fy(t, x). (5.18) 


Similar to the derivation of deterministic wave equations, the elastic force 
Fi(t,x) = Yze(t, x). The fiction depends on the property of the fluid and 
the velocity and shape of the string. When y, y, and y, are small, F (t,x) 
approximately depends on them linearly, that is, Fo = a1y, + aay + agy for 
some suitable functions a4, a2 and a3. From the classical theory of Statistical 
Mechanics (e.g., [308, Chapter VI]), the random impulse F4(t,x) at time t 
and position x can be approximated by a Gaussian stochastic process with 
a covariance k(-,y), which also depends on the property of the fluid. More 
precisely, 


t 
F(t, x) = n k(x, y(s, x))dW (s). 
0 
Thus, the equation (EIX) can be rewritten as 
dy: (t, x) = Ysa (t, x)dt + Fo(t,x)dt + F3(t,x)dt + k(x,y(t,x))dW(t). (5.19) 


When y is small, we may assume that k(-,y) is linear w.r.t. y. In this case, 
k(x, y(t, x)) = ki(x)y(t, x) for a suitable kı(-). More generally, one may assume 
that kı depends on t (and even on the sample point w € 2). Thus, (E-IJ) is 
reduced to the following: 


dyi(t, £) = You(t, x)dt + Fo(t,x)dt + F3(t, x)dt + ki (t,x) y(t, x)dW (t). (5.20) 


Many biological behaviors are related to the motions of DNA molecules. 
Hence, there is a strong motivation for controlling these motions. In (6.20), 
F3(-,-) in the drift term and a part of the diffusion term can be designed as 
controls on the fluid. Furthermore, one can act some forces on the endpoints 
of the molecule. In this way, we arrive at the following controlled stochastic 
wave equation: 





dy, = (You + à1ys + ary: + azy + f)dt 


-F(aay + g)dW(t) in (0, T) x (0, L), 
y= hı on (0, T) x {0}, (5.21) 
y — ha on (0, T) x {L}, 
y(0)= y0, y(0) =y in (0, L). 


In (EZD), (f, g, hi,h2) are controls which belong to some suitable spaces, a4 
is a suitable function, while (yo, y1) is an initial datum. 
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A natural question is as follows: 


Can we drive the DNA molecule (governed by (E-ZI)) from any (yo, y1) 
to a given configuration by choosing suitable controls (f, g, hi, h2)? 


Clearly, this is a controllability problem for the stochastic wave equation 
(E.ZI). Although there are four controls in the system (EZI), the answer 
to this question is negative (see Theorem in Chapter [IU). This differs 
completely from the well-known controllability property for the deterministic 
version of (E-ZI]). Indeed, for the latter, under some mild assumptions, one 
can prove the corresponding exact controllability (e.g., [LTU, 207, B89, B96]). 
Since (6-20) is a generalization of the classical wave equation to the stochastic 
setting, as remarked in our paper [247], from the viewpoint of Control Theory, 
some key feature has been ignored in the derivation of this equation. 

Motivated by the above-mentioned negative controllability result, in what 
follows, we shall propose a refined model to describe the DNA molecule. For 
this purpose, we partially employ a dynamical theory of Brownian motions, 
developed in [265], to describe the motion of a particle perturbed by ran- 
dom forces. In our opinion, the essence of the theory in [265] is a stochastic 
Newton's law, at least in some sense. 

According to [265, Chapter 11], we may suppose that 


vta) f iis yis | F(s,x,y(s))dW (s). (5.22) 


Here 9(*,-) is the expected velocity, F'(-,-,-) is the random perturbation from 
the fluid molecule. When y is small, one can assume that F'(-,-,-) is linear in 
the third argument, i.e., 


F(s,x, y(t, x)) = bi (t, x)y(t, x) (5.23) 


for a suitable bi (^, -). 
Formally, the acceleration at position x along the string at time t is %(t, x). 
By Newton's second law, it follows that 


M(t, x) = FA(t x) + Folt, x) + F(t, x) + Falt, x). 
Similar to (6.20), we obtain that 
dg(t, £) = yss (t, v)dt + Fo(t, x)dt + Fa(t, x)dt + ki(t, z)y(t, z)aW (t). (5.24) 
Combining (2.22), (6.23) and (6.24), we arrive at the following modified ver- 
sion of (6.20): 
dy = ydt + bıydW (t) in (0, T) x (0, L), (5.25) 
dij = (Yeu + a1ys + aay, + agy)dt + aqydW (t) in (0, T) x (0, L). 


Then, similar to (E-ZI), we obtain the following control system: 
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dy = ydt + (by + f)dW (t) in (0, T) x (0, L), 
dij = (Yeu + a1ys + a2y + agy)dt 
-F(aay + g)dW(t) in (0, T) x (0, L), (5.26) 
y= hy on (0, T) x {0}, 
y= ha on (0, T) x {L}, 
y(0)=yo, $(0-w in (0, L), 


where (f, g, hi, h2) are controls which belong to some suitable spaces. Under 
some assumptions, we shall show the exact controllability of the above system 
(See Theorem in Chapter 1). This, in turn, justifies our modification 


Example 5.4. Stochastic Schrodinger equation 
To investigate open quantum systems, people introduced the following 
stochastic Schrodinger equation (e.g., [I69]): 


dy(t, x) = (É u(t, 2) — iV(z)y(t,z) — F|aPy(t,«)) dt 


+V/ay(t, x)vdW (t) in (0, T) x G, 
y=0 on (0, T) x 0G, 
y(0) — yo in G. 

(5.27) 


Here G is a domain in R™ (m € N), y(t, x) stands for the wave function at 
time t € [0, T] and z € G, W(-) is an m-dimensional Brownian motion, a is a 
positive constant, V is a suitable real function and yo € L?(G; C) is the initial 
state. A derivation of (6.27) is given below. 

For simplicity, we consider the continuous measurement of the position 
of a one-dimensional quantum particle (m = 1) governed by the standard 
Hamiltonian . 

i 


Let us first recall the following postulates in Quantum Mechanics (e.g., {[84]). 


1. Non-ideal measurement principle. 
After a measurement, the wave function y(t, x) is transformed into a new 
one which, up to a normalization, reads 


y(t, ce 0-40». 


where q(t) € R is the result of the measurement at time t and a charac- 
terizes the accuracy of the measurement. 

2. Continuous limit of discrete observations. 
Fix a time t and denote by n the times of the measurements. Take the 
above non-ideal measurements of the position of the quantum particle at 
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moments tg = kd, where 6 = t/n, n € N. As n — +00, the accuracy of 
each measurement will be proportional to the time duration 6 between 
successive measurements, i.e. @ = Ad, where A reflects the properties of 
the measuring apparatus. 


The above two postulates are standard in Quantum Mechanics. Next, we 
introduce a postulate about the errors of the measurement. 


3. Gaussian model of errors. Suppose that q(t) obeys the following rela- 
tion: 


2 1 
ds = ——Wé(t) for a constant A > 0. 5.28 
] «97 zw (5.28) 


Note that the evolution of the quantum system between measurements is 
governed by the law of free Hamiltonian. Hence, after n times measurements, 
the resulting wave function reads 

TL 
y(nd) = [| exe(-9X(« — q(k6))?} exp(—6H) yo. (5.29) 
k=1 
Letting n — +00 in (6.29), we obtain that 


y = e~ (Hf Ma—a(s))?ds) 


Yo. 
Hence, 

ye = —(H + A(x — q(t)))y. (5.30) 
The term Aq(t)?y can be dropped in (Æ30) because solutions to the equa- 
tion with and without the term Aq(t)?y are proportional and this difference 
is irrelevant in Quantum Mechanics (in which people are only interested in 
normalized states). In this way, we obtain the following equation: 


ye + (H + Aa?)y = 2Axqy. (5.31) 
Noting (EZA), we then replace the equation (6.31) by the following one: 
dy + (H + Az?)ydt = 2V AxydW (t). (5.32) 


This, after some obvious scaling, gives the first equation of (6.27) for one 
space dimension. 

People have two possible ways to put controls on (B32). One is absorb- 
ing/delivering the wave on the boundary. This leads to a boundary control 
in the drift term. The other is to put some external force when doing the 
measurement. This leads to an internal control in the diffusion term. With 
such controls, the equation (D.Z7]) becomes the following control system: 


dy = (54v —iV(az)y — 5 lal*y) dt 

t (V/ay + v)zdW (t) in (0, T) x G, (5.33) 
y=f on (0,T) x 0G, 
y(0) = yo in G. 
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Example 5.5. Stochastic Navier-Stokes equation 

To study turbulence, people introduced the statistical approach (e.g. [257 
262, 298, B31). In this framework, the velocity field of an incompressible fluid 
is described by a space-time vector-valued random field, which is governed by 
the following Navier-Stokes equation with some random force: 


us = vAu — uVu — Vp + f in (0,7) xG, 

divu = 0 in (0,T) x G, (5.34) 

u(0) = uo in G. 
Here G C R™ (m = 2 or 3) is a domain, v is a positive real number, u(t, x) = 
(ul (t, 2), --- ,u™ (t, £)) is the velocity of the fluid at time t and point z, uo is 
the initial datum of u, p(t, x) is the pressure of the fluid, f = f(t, x,u) is the 
external force acted to the fluid, which is caused by lots of small independent 
random disturbances. In many situations, it is reasonable to assume that the 


random force f(t,x,u) at time t and position x can be approximated by a 
Gaussian stochastic process as follows: 


df (t, T, u) S g(u)dW (t), 


where g is a suitable process depending on u, while W(-) is a cylindrical 
Brownian motion. Consequently, instead of (634), we obtain the following 
stochastic Navier-Stokes equation: 


du = (vAu — uVu — Vp)dt + g(u)dW(t) in (0,T) x G, 
divu = 0 in (0,T) x G, (5.35) 
u(0) = uo in G. 





To control the velocity of the fluid, one can put a force h in the drift term 
and a force ha in the diffusion term. Then the equation (E39) becomes 


du = (vAu — uVu — Vp + hi)dt + (glu) + h2)dW (t) in (0, T) x G, 
divu = 0 in (0,7) x G, 
u(0) = uo in G. 





Although the control problems for stochastic Navier-Stokes equations are very 
important both theoretically and in applications, due to the space limitation, 
we will not consider these problems in this book (See [TZ8, 32, BUI, B04] for 
some interesting works on this topic). 


5.3 Some Control Problems for Stochastic Distributed 
Parameter Systems 


Let H and V be two separable Hilbert spaces, and write £9 2 p AV; H). Let 
{W (t) }ejo,r] be a V-valued, F-adapted, standard Q-Brownian motion (with 
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Q being a given positive definite, trace-class operator on V) or a cylindrical 
Brownian motion on ((2,.7,F,IP). Denote by F the progressive c-field (in 
[0, T] x (2) w.r.t. F. In the sequel, to simplify the presentation, we only consider 
the case of cylindrical Brownian motion. 

Suppose that A generates a Co-semigroup {S(t)}:50 on H, U is a given 
separable metric space and a(-) : [0, T] x 2x H x U > H and b(-) : [0, T] x 
(2x H xU — £9 are two suitably given functions. Let us consider the following 
controlled stochastic evolution equation: 


dx(t) = (Ax(t) + a(t, x(t), u(t)))dt 
+)(t, 2(t),u(t))dW(t) ^ in(0,1], (5.36) 
x(0) = xo. 


Here xo is the initial state (in a suitable set Ho consisting of some H-valued, 
Fo-measurable random variables), x(-) is the state variable (valued in H), u(-) 
is the control variable (valued in U), and hence H and U serve as the state 
and the control spaces, respectively. 

Write 


uo, T] 2 {u : [0, T] x 2 — U | u(-) is F-adapted}. 


This is the (biggest) control class that we shall use. Such a choice of controls 
means that one can only use the information (as specified by the filtration F) 
of what has happened up to the present moment, rather than what is going to 
happen afterwards due to the uncertainty of the system under consideration 
(as a consequence, for any t € [0,T] one cannot perform his/her action u(t) 
before the time £ really comes). This nonanticipative restriction is the reason 
for us to choose u(-) to be F-adapted. 

Let U? [0, T] be a suitable subset of 4[0, T], and Hr a suitable set consisting 
of some H-valued, J"r-measurable random variables. We suppose that the 
choices of the functions a(-) and b(-) and the sets Ho and the control class 
U?[0, T] are such that, for any zo € Ho and u(-) € 4?[0, T], the system (E30) 
admits a mild solutionl! z(-) in some solution space S[0, T] (in which solutions 
are understood in the sense of Definition BY), say Cr([0, T]; LP (2; H)) (for 
some p > 2) as that in Theorem BIA. 

Let Z be a nonempty set, and J’ be a nonempty subset of Z. Suppose 
F: S[0,T]xU°[0,T] — Z is a given map. Motivated by [B70, p. 14] and [50], 
we introduce the following notions of controllability: 


Definition 5.6. 1) The system (E-38) is said to be (F, D')-exactly controllable 
(or simply exactly controllable in the case that (F, I^) is clear from the context) 


1 Here, we do not need to assume the solution is unique. Solutions to (E38) can 
also be understood in other sense, say transpositions (for the case of unbounded 
control operators) which will be introduced in Definition LI of Chapter A. 


5.3 Some Control Problems for Stochastic Distributed Parameter Systems 201 


if for any xo € Ho and x, € I, there is a control u(-) € U?[0, T] such that 
(6.30) admits a mild solution x(-) satisfying 


F(x(-),u(-)) = zi (5.37) 


2) The system (B30) is said to be (F,I’)-approximately controllable (or 
simply approximately controllable in the case that (F,I) is clear from the 
context) if Z is another metric space with a metric dz(-,-), and for any xo € 
Ho, x1 € I and € > 0, there is a control u(-) € U?(0, T] such that (E30) 
admits a mild solution x(-) satisfying 


dz(F(z(-),u(-)) 21) «€; 


3) The system (6.30) is said to be (F, I')-controllable (or simply control- 
lable in the case that (F, I) is clear from the context) if for any xo € Ho, 
there is a control u(-) € U9[0, T] such that (6:38) admits a mild solution x(-) 
satisfying 

F(a(-),u(-)) ET. (5.38) 


Clearly, the above controllability notions are quite general, which include 
the usual exact/null/approximate controllability studied in the literature. For 
example, let us choose Hı to be a metric space consisting of suitably H- 
valued, J^r-measurable random variables so that 0 € ?/£4. For Z =H ,, =Z 
and F(a(-),u(-)) = x(T), we get the exact/approximate controllability; for 
Z = Hı, I = {0} and F(a(-),u(-)) = z(T), we get the null controllability. 
Further, for 

Z = Hı x Hı, I = {0} x {0} 


and 
(T) 


Falu) =| pt ; 
f M(T — s)x(s)ds 


in which M(-) : [0, T] —> R is a given function, we get the memory-type null 
controllability of (E30) (See [bU] for examples in the deterministic setting). 
Clearly, the (F, I)-controllability concept is too general to obtain meaningful 
results, and therefore in the rest of this book we will focus mainly on exact /null 
controllability. Nevertheless, as we shall see later, (F, I')-controllability is a 
basis for the study of optimal control problems for (6.36). This is quite natural 
because, as we mentioned in the first chapter, controllability actually means 
“feasibility” for many activities (at least in some broad sense). 

Clearly, the map F : S[0, T] x 4?[0, T] — Z can also be viewed an input- 
output operator, while I can be regarded as a (“measurable”) observation. 
Similarly to Definition EH, we introduce the following notions of observability: 


Definition 5.7. 1) The system (6.36) is said to be (F, I')-exactly observable 
(or simply exactly observable in the case that (F, I^) is clear from the context) 
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if for any control u(-) € M9[0, T] and observation y € I, there is a unique 
initial datum xo € Ho such that the corresponding mild solution x(-) to (E30) 
is unique and satisfies 


F(z(),u()) =7; (5.39) 


2) The system (30) is said to be (F, D')-continuously observable (or simply 
continuously observable in the case that (F,I') is clear from the context) if 
S[0, T], U°[0,T] and I" are metric spaces, and for any control à(-) € U9[0, T], 
observation 4 € I' and £ > 0, there exists 6 = ô(£) > 0 and a unique initial 
datum $ € Ho such that the corresponding mild solution 2(-) to (E-30) (with 
(zo, u) replaced by (2o, û)) is unique and satisfies 


and for any control u(-) € U9[0, T] and observation y € I^ satisfying 


duopo,r](uC), &(-)) + dr(y, 5) <€, (5.41) 


there is a unique initial datum xg € Ho such that the corresponding mild 
solution x(-) to (E30) is unique, and satisfies (E39) and 


dsp,r](zC), £()) < 4; 


3) The system (6.38) is said to be (F, D)-continuously initially observable 
(or simply continuously initially observable in the case that (F,D) is clear 
from the context) if Ho, WU? [0, T] and I" are metric spaces, and for any control 
&(-) € U?[0, T], observation 4 € I and e > 0, there exists 6 = 5(€) > 0 and a 
unique initial datum ĉo € Ho such that the corresponding mild solution &(-) 
to (E30) (with (xo, u) replaced by (29, û)) is unique and satisfies (40), and 
for any control u(-) € U°[0,T] and observation y € I’ satisfying (ŒE), there 
is a unique initial datum zo € Ho such that the corresponding mild solution 
x(-) to (B36) is unique, and satisfies (E39) and 


dat, (zo, $9) € à; 


4) The system (E30) is said to be (F,I')-continuously finally observable 
(or simply continuously finally observable in the case that (F, I") is clear from 
the context) if Hr, U?|0, T| and I are metric spaces, and for any control 
&(-) € U?[0, T], observation 4 € I and € > 0, there exists 6 = 5(€) > 0 and a 
unique initial datum ĉo € Ho such that the corresponding mild solution &(-) 
to (E30) (with (xo,u) replaced by (ĉo, à)) is unique and satisfies (6.40), and 
for any control u(-) € U°[0,T] and observation y € I^ satisfying (EX), there 
is a unique initial datum zo € Ho such that the corresponding mild solution 

x(-) to (E30) is unique, and satisfies (B39) and 


dy, (r(T), &(T)) < ô. 
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'The above observability notions are also quite general, which include the 
usual exact/internal/boundary observability studied in the literature. Partic- 
ularly, the above continuous observability and continuous initial observability 
include various observability estimates which are extensively studied for many 
partial differential equations. Roughly speaking, observability means that peo- 
ple may recognize the whole state under consideration through the observation 
part. In the deterministic setting, the observation problems are strongly re- 
lated to the controllability problems, which are actually dual to each other at 
least for linear systems. However, in the stochastic situation, as we shall see in 
the next two chapters, the relationship between the controllability problems 
and the observation problems are much more complicated. 

Note also that, the observation problems make sense even if there is no 
control variable in the system (6.30) (The corresponding problems can be 
easily formulated as special cases as that in Definition EJ). In this way, the 
observation problems may contain also various inverse problems which are 
also extensively studied in the literature for deterministic differential equa- 
tions. Nevertheless, in this book we shall focus more on control problems, and 
therefore, the observation problems are considered only as auxiliary tools for 
studying the controllability problems. 

More importantly, in order to solve the controllability problem for the for- 
ward system (£36), as we shall see in Section of Chapter M, stimulated 
also by [275], people need to analyze suitable controllability and/or observ- 
ability problems for some backward stochastic evolution equations. Because 
of this, we shall give below a general formulation of backward controllabili- 
ty/observability problems in the stochastic setting. 

Suppose that a(-) : [0,7] x 2x H x £L} x U > H and b(-) : [0, T] x 2 x 
H x U + £9 are two suitably given functions. Let us consider the following 
backward stochastic equation evolved in H: 


dy(t) = (— A*y(t) + a(t, y(t), w(t), Y (£)))at 
+(d(t, u(t), y(t)) + Y (t)) aW (t) in [0, T), (5.42) 
y(T) = yr. 


Here u(-) € U°[0, T], yr € Hr is the final state. We suppose that the choices of 
the functions a(-) and b(-) and the sets U? [0, T] and Hr are such that, for any 
yr € Hr and u(-) € u?[0, T], the system (E12) admits a (mild/transposition) 
solution” (y(-), Y (-)) in some solution space S[0, T] x 7[0, T] (in which so- 
lutions are understood in the sense of Definition IEB or Definition ILT3), say 
(y). Y) € LER; C(D, T]; H)) x L3 T; L?(2; £3)) (for some p € (1, 2) 
as that in Theorem EZA. 


? Here, similarly to that for the system (6238), we do not need to assume the solution 
to (6-42) is unique. Also, solutions to (42) can be understood in other sense, say 
transpositions (for the case of unbounded control operators, even if the filtration 
F is natural) which will be introduced in Definition of Chapter A. 
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Suppose G : S[0, T] x 7 (0, T] x U°[0,T] — Z is a given map. Similarly to 
Definition EH, we introduce the following notions of controllability: 


Definition 5.8. 1) The system (@.42) is said to be (G, I')-exactly controllable 
(or simply exactly controllable in the case that (G, I") is clear from the context) 
if for any yr € Hr and yo € T, there is a control u(-) € U9[0, T] such that 
(D-T2) admits a mild/transposition solution (y(-), Y (-)) satisfying 


G(yC), Y C), uC)) = wo; 


2) The system (6.42) is said to be (G, D')-approximately controllable (or 
simply approximately controllable in the case that (G, I^) is clear from the 
context) if Z is another metric space, and for any yr € Hr, yo € I' ande > 0, 
there is a control u(-) € u9[0, T] such that (6:42) admits a mild/transposition 
solution (y(-), Y (-)) satisfying 


dz(G(yC); Y(-), u(-)), Yo) <£; 


3) The system (6.42) is said to be (G, D)-controllable (or simply control- 
lable in the case that (G, T) is clear from the context) if for any yr € Hr, 
there is a control u(-) € 9[0, T] such that (642) admits a mild/transposition 
solution (y(-), Y (-)) satisfying 


Gy), Y C), uC) € T- (5.43) 


Also, similarly to Definition EJ, we introduce the following notions of 
observability: 


Definition 5.9. 1) The system (6.42) is said to be (G, D')-ezactly observable 
(or simply exactly observable in the case that (G, I") is clear from the context) 
if for any control u(-) € M9[0, T] and observation y € I, there is a unique 
final initial datum yr € Hr such that the corresponding solution (y(-), Y (-)) 
to (D-T2) is unique and satisfies 


G(yC) Y C), uC) = * (5.44) 


2) The system (6.42) is said to be (G, I')-continuously observable (or sim- 
ply continuously observable in the case that (G, T) is clear from the contex- 
t) if So, T], T(0, T], 4?[0, T] and I are metric spaces, and for any control 
&(-) € U?[0, T], observation 4 € I and e > 0, there exists 6 = 6(€) > 0 and a 
unique final datum ĝr € Hr such that the corresponding solution (9(-), Y (-)) 
to (B42) (with (yr, wu) replaced by (Gr, à)) is unique and satisfies 


and for any control u(-) € U9[0, T] and observation y € I^ satisfying 


duoo,rj(uC-), à(-)) + dr(y, 3) < e, (5.46) 
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there is a unique final datum yr € Hr such that the corresponding solution 
(yC), Y -)) to (242) is unique, and satisfies (EZA) and 


dso.r(y),9()) dri; (Y C. Y O)) < 6; 


3) The system (842) is said to be (G, I')-continuously finally observable 
(or simply continuously finally observable in the case that (G, D) is clear from 
the context) if Hr, U?|0, T] and I are metric spaces, and for any control 
à(-) € u9[0, T], observation 5 € I and £ > 0, there exists 6 = 5(€) > 0 and a 
unique final datum ĝr € Hr such that the corresponding solution (i(-), Y (-)) 
to (B22) (with (yr, wu) replaced by (Gr, à)) is unique and satisfies (E43), and 
for any control u(-) € U9[0, T] and observation y € I satisfying (E30), there is 
a unique final datum yr € Hr such that the corresponding solution (y(-), Y (-)) 
to (D-32) is unique, and satisfies (44) and 


dau, (yr. Ür) < ð; 


4) The system (6.42) is said to be (G, I')-continuously initially observable 
(or simply continuously initially observable in the case that (G, T) is clear 
from the context) if Ho, UP [0, T] and I" are metric spaces, and for any control 
à(-) e u9[0, T], observation 4 € I' and £ > 0, there exists 6 = d(e) > 0 and a 
unique final datum r € Hr such that the corresponding solution (9(-), Y (-)) 
to (B-32) (with (yr, wu) replaced by (Gr, à)) is unique and satisfies (E49), and 
for any control u(-) € U°[0, T] and observation y € I^ satisfying (40), there is 
a unique final datum yr € Hr such that the corresponding solution (y(-), Y (-)) 
to (2:42) is unique, and satisfies (44) and 


dHo (y(0), $(0)) <ô. 


In this book, as a key step to solve the stochastic controllability problems, 
we shall employ mainly the global Carleman estimates to derive observability 
estimates for some backward /forward stochastic evolution equations in infinite 
dimensions. 

In the rest of this section, we fix a nonempty set Z, a nonempty subset I" 
of Z and a map F : S[0, T] x 4?[0, T] — Z, and we suppose that the system 
(E-38) is (F, D)-controllable. 

For any fixed functions f(-,-,-) : [0,T] x S(0, T] x u?[0, T] — R and 
h(): H — R, we introduce a cost function J(-,-) : S(0,T] x U°[0,T] > R 
for the control system (6.3) as follows: 


J((),u()) = iE Fel), uC))dt + h(e(T ») (5.47) 
(z(-), u()) € S[0, T] x W [0, T]. 














Denote by Uaal0, T] the set of all controls u(-) € U?[0, T] such that for some 
zo € Ho, (E30) admits a mild solution x(-) satisfying (E-3N) and 
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fC,2(),u()) € LOT) and h(x(T)) € Lz, (0). (5.48) 


Also, denote by Paal0, T] the set of all pairs (z(-),u(-)) € S[0, T] x 4° [0, T] 
such that for some zo € Ho, x(-) is a mild solution to (6.36) satisfying 
(6.38) and (@48). Clearly, under our (F, T)-controllability assumption on 
the system (638), both 44[0, T] and Paal0, T] are non-empty. Any control 
u(-) € Uaal0, T] (resp. pair (z(-),u(-)) € Paa[0,T]) is called an admissible 
control (resp. pair). 

The optimal control problem for the system (6.30) with the cost functional 
(D) is formulated as follows: 


Problem (SOP) Find a (z(-),u(-)) € Paa[0, T] such that 


J(z(),u()) = (z(-), u(-)). (5.49) 


inf 
(2(-),u(-)) € Paa[0,T] 


Any (z(-),u(-)) € Paal0, T] satisfying (6-49) is called an optimal pair (for 
Problem (SOP)), and z(-) and ü(-) are called respectively an optimal state 
and an optimal control. 

Similarly, we fix a map G : S[0, T] x T[0, T] x 4?[0, T] —> Z, and we 
suppose that the system (6.42) is (G, )-controllable. 

For any fixed functions g(-,-,-) : (0, T] x S[0, T] x T[0, T] x u9[0, T] 2 R 
and h(-) : H —> R, we introduce a cost function 7(-,-,-) : S[0,T] x T[0, T] x 
U?[0, T] — R for the control system (6:42) as follows: 














T 
T(y(-), ¥(-), wu) = Ji g(t.yC) Y C), u())dt + h(y(0)), 
V (y), Y C), uC)) € S[0, T] x 710, T] x u?[0, T]. 


(5.50) 


Denote by Uaal0, T] the set of all controls u(-) € U°[0,T] such that for some 
yr € Hr, (E22) admits a solution (y(-), Y (-)) satisfying (243) and 


9C, y C), YC) u(-)) € LEl, T). (5.51) 


Also, denote by Paal0, T] the set of all triples (y(-), Y (-), u 
T0, T] x 49[0, T] such that for some yr € Hr, (y), Y(-)) is a solution to 
(6-42) satisfying (D-E3) and (B-5T). Clearly, under our (G, ’)-controllability 
assumption on the system (642), both Uaal0, T] and P,4[0, T] are non-empty. 
Any control u(-) € Uaa[0, T] is called an admissible control. 

The optimal control problem for the system (E2) with the cost functional 
(E0) is formulated as follows: 


Problem (BSOP) Find a triple (g(-), Y(-), u(-)) € Paa[0, T] such that 


J (9C), Y C), UC) J (C) Y) uC))- (5.52) 


,u(-)) € S(0, T] x 


= inf 
(y(-),¥ (-),u(-)) € Paa[0,T] 


5.4 Notes and Comments 207 


Any (9(-), Y(-), u(-)) € Paa[0, T] satisfying (6:52) is called an optimal triple 
(for Problem (BSOP)), and (g(-), Y (-)) and ū(-) are called respectively an 
optimal state and an optimal control. 

In this book, we shall address only Problem (SOP) (Actually, Problem 
(BSOP) is much easier to handle than Problem (SOP)). We shall derive the 
first and second order necessary conditions for optimal controls for Problem 
(SOP), and also characterize the optimal feedback operators for a special 
version of this problem. The main difficulty to do all of these is how to estab- 
lish the well-posedness of the operator-valued backward stochastic evolution 
equations (including operator-valued backward stochastic Lyapunov/Riccati 
equations in infinite dimensions in particular). To do this, we shall systemat- 
ically employ our stochastic transposition method. 


5.4 Notes and Comments 


'The stochastic control systems presented in this chapter are well-known except 
the system (E-28) (and its high dimensional counterpart (ITA) in Chapter 
(IU)) introduced in [227]. 

Our formulation of (F,I)- (resp. (G,I°)-) controllability /observability 
problems for the system (6.30) (resp. (&.42)) are quite general, even if the 
system is reduced to deterministic equations in finite dimensions. The same 
can be said for optimal control problems for the systems (E30) and (EZ), 
ie. Problems (SOP) and (BSOP). Of course, in this book (as any of other 
works on Control Theory), we have to focus on more specific controllability 
and optimal control problems. Also, we emphasize again that controllability 
is the basis for optimal control problems though the controllability for the 
stochastic optimal control problems to be studied in this book is obvious. 

'There are many other control problems for stochastic distributed param- 
eter systems which deserve careful studies (but they are not addressed to in 
this book), for example: 


e In the field of control theory for stochastic finite dimensional systems, 
stochastic approximation, system identification and adaptive control (|52, 
53, IXI, B4U]) are important topics. It would be quite interesting to study 
their infinite dimensional counterparts but it seems that not too much are 
known in this respect (See however [83] and the two books [L5 167] for 
some very interesting related works). 

e There exist numerous works on inverse problems for deterministic equa- 
tions. However, very little are known for the relatively unexplored but 
important subject of inverse problems for stochastic partial differential 
equations. By means of the tools that we developed for solving the s- 
tochastic controllability problems, in [226, 229, 243] we initiated the s- 
tudy of inverse problems for stochastic partial differential equations (See 
(98, 238, B53), B59, BGG, B73, B74, B75) for further progress), in which the 
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point is that, unlike most of the previous works in this topic, the problem 
is genuinely stochastic and therefore it cannot be reduced to any deter- 
ministic one. Especially, it was found in [243] that both the formulation 
of stochastic inverse problems and the tools to solve them differ consider- 
ably from their deterministic counterpart. Indeed, as the counterexample 
in [243, Remark 2.7] shows, the inverse problem considered therein makes 
sense only in the stochastic setting! 

There exist numerous works on the stability/stabilization problems for 
deterministic equations. However, very little are known for the same prob- 
lems but for stochastic partial differential equations (We refer to [216] for 
some results on this topic). Further, we remark that, it would be quite 
interesting to extend the famous backstepping method for handling the 
stabilization problems of some deterministic partial differential equations 
([Lz2]) to the stochastic setting but this remains to be done. 

It is well-known that Game Theory is strongly related to Control Theory. 
In recent years, there are many studies on stochastic differential games 
(e.g., B9, ÆN, 99]). It would be quite interesting to develop game theory for 
stochastic distributed parameter systems but, as far as we know, nothing 
has been done in this direction. 

In recent years, there are many works on the time-inconsistent optimal 
control problems for stochastic differential equations (See [B69] and the 
references cited therein). It would be quite interesting to study the same 
problems but for stochastic evolution equations in infinite dimensions. As 
far as we know, [76] is the only publication on this topic. 

In recent years, there are some works on control problems for stochastic 
systems with fractional Brownian motions (e.g., [82]). It would be quite 
interesting to study carefully this sort of problems (especially those in 
infinite dimensions). 

It seems that numerical methods for solving control problems of stochastic 
distributed parameter systems are almost blank (See [283] for the only one 
work that we know). Very likely, people need to develop completely new 
algorithms for these problems. 

'The control problems presented in this chapter and mentioned above make 
sense also for forward-backward stochastic evolution equations, stochas- 
tic evolution equations driven by G-Brownian motions, forward-backward 
doubly stochastic evolution equations, stochastic Volterra integral equa- 
tion in infinite dimensions or stochastic evolution equations driven by gen- 
eral martingales (even with incomplete information). Also, it seems inter- 
esting to study recursive optimal control problems for stochastic evolution 
equations and/or the above mentioned stochastic equations. As far as we 
know, all of these problems remain to be done, and very likely people might 
need to develop new tools to obtain interesting new results. 


f 


Check for 
updates 
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Controllability for Stochastic Differential 
Equations in Finite Dimensions 


In this chapter, we are concerned with the controllability problem for the 
simplest stochastic linear evolution equations, i.e., stochastic linear differential 
equations (with constant coefficients) in finite dimensions. A Kalman-type 
rank condition to characterize the exact controllability is given for the special 
case that the control matrix in the diffusion term is of full rank. Nevertheless, 
generally speaking, the controllability of stochastic linear differential equations 
in finite dimensions is surprisingly different from its deterministic counterpart. 
Indeed, it will be shown further that 


e There is a very simple stochastic control system (in one dimension) which 
is exactly controllable by means of L!-in time controls but the same system 
is NOT exactly controllable anymore provided that one chooses L?-in time 
controls for any p € (1,09]; 

e One can construct a class of very simple stochastic control systems (in 
two dimensions) for which neither null nor approximate controllability is 
robust w.r.t. small perturbations. 


6.1 The Control Systems With Controls in Both Drift 
and Diffusion Terms 


Let T > 0 and (2, .F, EF, IP) be a complete filtered probability space on which 
a one dimensional Brownian motion W(.) is defined and F = {F;}rejo,r] is 
the natural filtration generated by W(-). Denote by F the progressive o-field 
w.r.t. F. 

Fix m,n € N. Let us consider the following linear controlled stochastic 
differential equation in IR": 





bo (Ay + Bu)dt + (Cy + Du)dW (t) in [0, T], 6.1) 
y(0) = Yo, l 
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where A € R?*^, B € R"*™, C € R?*" and D € R”*™, u(-) € L2(0,T;R™) 
is the control and y(-) € L2(0; C([0, T]; R")) is the state. 
We introduce the following notion of exact controllability for (2). 


Definition 6.1. The system (ET) is called exactly controllable (at time T) 
if for any yo € R” and yı € L2 (2; R"), one can find a control u(-) € 
L2(0,T;R™) such that the corresponding solution y to (ET) satisfies that 
y(T) =y. 
Define a (deterministic) function 7(-) on [0, T] by 
1 forte |(1 Ae ix )T) j-0,1,2 
n(t) = , or 22j , 22j41 >» J 5U, 1,4, E (6.2) 


—1, otherwise. 





One can check that (|Z75]) there exists a constant 6 > 0 such that 
T 
J In(s) — c| ds >46(T—t), V(c,t) €R x [0,T]. (6.3) 
t 


The following result is useful later. 
T 
Proposition 6.2. Let £ — n n(t)dW (t), where n(-) is given by (ŒA). Then, 


0 
it is impossible to find (01, 02) € L2(0, T) x Ce([0, T]; L?(2)) and yo € R such 
that 


q T. 
tw f etat f g»(t)dW (t). (6.4) 


Proof: We use the contradiction argument. Assume that (6&4) held for 
some (01, 02) € L2(0, T) x Ce([0, T]; L?((2)) and yo € R. Then, 


T 


T 
n (n(t) — o2(t)) aW (t) = yo + f 01 (£)dt. 
0 0 


Hence, 


t 


[ 9 aawo) ae fotos (f mas | 7). 


'This gives 


[sy - etymo f aoa- f ois | nz). 


which yields that 


d In(s) — ox(s)| ds = (f. 21 (s)ds — (f 01(s)ds | F) 


< (f oi(s)ds) < e-of louis) 






























































(6.5) 
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On the other hand, it follows from the inequality (3) that 














* 2 
E I Om Ol. 


T 
> 5E | |n(s) — ox(T)| ds = ef lex (T) u 2(s)|"ds (6.6) 


























n 











T 
> 2T -t)-E | lex (T) — ex(s)| ds. 





Since o» € Cr(([0, T]; L?(Q)), there exists £ € [0, T) such that 





E|00(T)  ox(s)) € 8, Vs [eT]. 











This, together with (LG) implies that 














T 
Bf In - o d> eT- Vee FT) (6.7) 


It follows from (EH) and (E7) that 


T 5 7 
ex [ In(s) — exsl?ds, Vee [£T], 
t 


a contradiction. oO 


The following result gives some necessary conditions for the exact control- 
lability of (KT). 


Proposition 6.3. If the system (€T) is exactly controllable, then 

1) rank D =n; 

2) (A, B) fulfills the Kalman rank condition (C3). 

Proof: We use the contradiction argument to prove the conclusion 1). 
Assume that the system (KI) was exactly controllable for some matrix D 
with rank D < n. Then, we could find a vector v € R” with |v|g« = 1 such 
that v! Dyo = 0 for any yo € R”. 


Let yı = £v, where £ is given in Proposition EZ. By the exact controlla- 
bility of (G1), one can find a control u € L2(0, T; IR") such that 


T T 
EE f (Ay(t) + Bu(t))dt + n (Cw(t) + Du(t))aw (t), 


which implies that 


T T T 
f n(t)dW (t) = v! yo +f v! (Ay(t) + Bu(t)at» | v! Cy(t)dW (t). 
0 0 0 


This contradicts Proposition EZ. 
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In order to prove the conclusion 2), write 7 = Ey, where y is a solution to 
(G1) for some yo € R” and u(-) € L2(0,T;R™). Then @ solves 








dij - 
— = Ağ + BEu in [0,T], 

d ^4 al (6.8) 
g(0) = yo- 











For any yi € R”, since (G1) is exactly controllable at time T, we can find a 
control u € L2(0, T; IR") such that the corresponding solution to (KT) satisfies 
that y(T) = yi. Then we have that g(T) = E(y(T)) = Ey: = yı. This implies 
that (KH) is exactly controllable at time T. Thus, in view of Theorem LA, 
(A, B) fulfills the Kalman rank condition. Oo 


























By means of Proposition E3, we should assume that rank D = n and (A, B) 
fulfills the Kalman rank condition if we expect the exact controllability of the 
system (I). In the rest of this section, we keep this assumption. 

Since rank D = n, we have n < m. Thus, there exist two matrices Ky, € 
R™*™ and Ko c R?*" such that 


DK, =(In,0), | DKs;--O, (6.9) 


where /, is the identity matrix in IR"*", Introduce a simple linear transfor- 
mation as 


Y 
u = Kı + Kəy, (6.10) 
v 


where Y € L2(0, T;R") and v € L2(0, T; R^"). Then the system (EzI) is 
reduced to 


dy = (A1y + AY + Byv)dt + YaW (t) in [0, T], 
ae = Yo; we 
where 
A, =A+BERy, A4 ER”, Ber, 
(6.12) 


Y 
AY + B4v = Bky . 
v 


Clearly, (G11) can be viewed as a controlled system, in which (Y, v) is the 
control variable, and y is still the state variable. Similarly to Definition EJ, 
one can define the exact controllability (at time T) of (€). It is easy to 
show the following result. 


Proposition 6.4. [frank D = n and (KIT) is exactly controllable, then so is 
the system (€T). 
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Remark 6.5. At this moment, it seems unclear whether the reverse of Propo- 
sition EA is true or not. Indeed, suppose that the system (KLTl is exactly 
controllable, then by Proposition EA, rank D = n; moreover, for any yo € R” 
and y; € L*.. (2; R”), there is a control u(-) € Lz(0, T; IR") so that the cor- 
responding solution y to (KLT) verifies that y(T) = yi. Write 


Y = Du — DKsy, 

Biv = B(u = Koy) == AY = (B = AD) (u = Koy). 
Then, by (KC93)-(E-T2), it is easy to see that y, Y and Bv satisfy (G11) and 
y(T) = yi. However, we do not know whether it is possible to find v from the 


algebraic equation B1v = (B — A3D)(u — Kay). If v can be found in this way, 
then (€N) is exactly controllable at time T, as well. 


In order to deal with the exact controllability problem for (II), we con- 
sider the following controlled backward stochastic differential system: 


I = (A1y + AY + Biv)dt + YaW (t) in [0, T], (6.13) 
6.13 


y(T) = Ui; 
where yı € Li, (2; R”), v € L2(0,T;R™~”) is the control variable. 


Definition 6.6. The system (ETA) is called exactly controllable (at time 
0) if for any yı € L*. (2; R”) and yo € R”, there is a control v € 
L2(0, T; R^Xn—)) such that the corresponding solution (y(-), Y (-)) € L2(Q; 
C([0, T|; IR?)) x L2(0, T; R”) to (EIJ) satisfies y(0) = yo. 





It is easy to show the following result: 


Proposition 6.7. The system (€) is exactly controllable if and only if so 
is the system (G13). 


The dual equation of the system (13) is the following (forward) stochastic 
ordinary differential equation: 


dz = —Alzdt — A] zaW (t) in [0, T], 
l 1 2 (t) in [0,7] (6.14) 


z(0) = 29 € R”. 
Similar to Theorem [L2, one can show the following result: 


Theorem 6.8. The following statements are equivalent: 
1) The system (G13) is exactly controllable; 
2) Solutions to (EIA) satisfy the following observability estimate: 














T 
Izo? <C J |B] z(t) [^ dt, V 2% ER”; (6.15) 
0 
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3) Solutions to (EITA) enjoy the following observability: 
BĮ 2(-) 2 0 in (0, T), as. > zo = 0; (6.16) 
4) The following rank condition holds: 
rank [B,, AiB4, A3B1, A? Bı, Ai A2B,, A2B, AgAiBs,---]— m. (6.17) 


Proof: *1)«— 2)". Similarly to the deterministic setting, it suffices to con- 
sider the special case that the final datum yı in the system (ÆI) is equal to 
0. We define an operator G : L2(0, T; R^") > R” by 


G(v()) = (0), Vv() € E20, T; R7"), (6.18) 


where (y(-), Y (-)) is the corresponding solution to (ECT3) with y; = 0. Then, 
applying Itó's formula to (13) (with y; = 0) and (ŒI), we obtain that 














Tq 
NS NES Ji (Byv(t), 2(t) edt, V2 € R^. (6.19) 


where z(-) solves (614). By (18)—-(€19), it is clear that, 
(G*zo)(t) = —B} z(t), a.e. t € [0,7]. (6.20) 


Now, the exact controllability of (13) is equivalent to that R(G) = IR"; while 
the latter, by (20) and using Theorem [L2 (with G defined by (IN) and F 


being the identity operator in R”), is equivalent to the estimate (G14). 


The proof of “2)<= 3)” is easy as that in Theorem (because R” is 
finite dimensional). 


^4) —253)". We use an idea from the proof of [275, Theorem 3.2]. Let us 
assume that Bj z(-) = 0 in (0, T), a.s. for some zo € R”. Then, 


t t 
Bi z(t) -Blas[ BI AT 2(s)d5+ f Bj Ag z(s)dW(s) =0, Vte(0,T). 
0 0 
Therefore, 
Bla=0, BlA[z50, BJ Alz=0. (6.21) 
Hence B] A] zo = By Aj zo = 0. 
Noticing that z(-) solves (14), by (G21), we have 
t t 
BĮ A] z = Bl Aj} zo +f B] Aj Aj z(s)ds +f Bj Aj Aj z(s)dW(s) =0 
0 0 


and 


t t 
BIA es BT Tad. | BY ATA eye | BATA eT Sh 
0 0 


6.1 The Control Systems With Controls in Both Drift and Diffusion Terms 215 


Hence, 





BT ATAT z= B] ATA] z= B] AL ATz = B] A] Al z 5 0, 


which implies 





BAA e BEAT AT e BI A A aec BLATAT a e i 
Repeating the above argument, we conclude that 
zd (Bi, A,B, A2 Di, AZB, A142 B, AS B, Aj A,B, se -] = 0. (6.22) 


By (E-TZ) and (&EZJ), it follows that zo = 0. 


“3)==>4)”. We use the contradiction argument. Assume that (B.I7) was 
false. Then, we could find a nonzero zo € R” satisfying (€22). For this zo, 
denote by z(-) the corresponding solution to (€14). Clearly, z(-) can be approx- 
imated (in L2(2; C([0, T]; IR^))) by the Picard sequence 12; (-)) ;£.y defined as 
follows: 


zo(t) = 20; 


t t (6.23) 
zy(t) = zo «f A} zy 1(s)ds «f Ay zx-i(s)dW(s) kEN, 
0 0 


for any t € [0,7]. By (22) and (23), via a direct computation, one can 
show that 


BĮ z(-) =0, best L3 vc. (6.24) 
By (24), we deduce that Bj z(-) = 0 in (0, T). Hence, by (619), it follows 
that zo — 0, which is a contradiction. LI 


As a consequence of Theorem EA, we have the following characterization 
on the exact controllability of (€). 


Corollary 6.9. (|275]) The system (G11) is exactly controllable at time T if 
and only if the rank condition (ECT) holds. 


Note that the rank condition (K.T7) is not easy to verify because the matrix 
(Bı, Aı Bı, A3BD, A2B, A, AB, A2B, A3 A1BD,- « -) has infinite columns. 
To simplify this condition, we introduce two sequences of matrices (Mi, V2. , 
and (M3, 122. inductively as follows: 


Mii-—A44B1, M21 = A2B4, (6.25) 
and for k € N, 
Mi k41 = (A1Mı k, A1Mə k), M241 = (A2Mi,k, A2M»5,i). (6.26) 


We have the following Kalman-type rank condition to characterize the exact 
controllability of (6): 
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Theorem 6.10. The rank condition (G17) holds if and only if 
rank (Bi, Mi, M21, Mi, M22, Tem Mini; Mo,n-1) =n. (6.27) 


Proof: The “if? part is obvious. It suffices to prove the “only if" part. 
For any matrix M, we denote by span {M} the vector space spanned by the 
column vectors of M. 

If for each k € (1,--- ,n — 1}, there exists an m, € span (Mi k, M») such 
that 


ne € span { B1, Mi, Mo, Mio, Moo, , Misi, Mo,n-1}. 


then, {B1, M1; * +> ;m—1} is linearly independent, and therefore (627) holds. 
Now, we suppose that there is a k € {1,--- ,n — 1) such that 


span {M1 k, Mo) 


(6.28) 
C span (B1, Mi,1, M2,1, Mio, Ma, , Mii, Moi i)- 
Then, we claim that for any £ > k, 
span {My e, M20} 
(6.29) 


C span (B1, Mi, Mo, Mio, Ma,2,:-: , Miki, Ma,n-1}. 


We first consider the case that 4 = k +1. Let 7 € span {Mi 441}. Then 
n = Aim, where 7i € span {M1 k, Ma]. By (ECZ8), we find that 


m € span (B3, Mi, Mo.1, Mio, Ma3,:: Mia, M241}. 
Thus, 


Aym € span (Ai B1, Ai Mi 1, A41 M211, Ai Mio, A1Mo2,--- , 
A1Mi x, A1 Mai] 
C span (B1, Mi, Mo, Mi,2, Maj, , Miki, Mo, Mis, Mo) 
C span (B1, Mi, Moi, Mio, Ma, , Mii, Mo, i)- 


'This implies that 

span {M1441} C span (B1, Mi,1, Mo, Mis, Mos, , Miki, Mo,n-1}. 
Similarly, 

span {M2441} C span (B1, Mi, 1, M21, Mig; Mo 3, , Mi ki; Mak i]- 


Hence, (K2J3) holds for l = k + 1. By the induction argument, we see that 
(G29) holds for all > k. Hence, 
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span (B4, A,B), A3B1, A7 B1, Ai A2Bi, AB, A241 B1,- } 
C span (B4, Mı 1, M21, Mio, Ma, , Miki, Mo, i)- 


It follows from (©) that the dimension of span (B1, A1 Bi, A3 B1, A? B3, 
A, A2B,, A3B, AA, B1,- -- } is n. Thus, the dimension of span (B1, Mi 1, M21, 
Mi; Ma33,::: , Miki; M2,n-1} is also equal to n. This completes the proof 
of Theorem 6-10. oO 


Remark 6.11. By Remark EA, it is easy to see that the rank condition (KT) 
or (6.27) is sufficient for the exact controllability of (€) but maybe not nec- 
essary. It would be quite interesting to derive a rank condition to characterize 
the exact controllability of this system directly (rather than through that of 
the reduced system (61) or (613)). However, as far as we know, this is an 
unsolved problem. 


By Proposition EA, in order that the system (KI) is exactly controllable, 
one needs rank D = n, which means that the control has to be active every- 
where in the diffusion term of this system. Clearly, this is unsatisfactory for 
many practice problems. How to avoid this? One possibility is to relax the 
class of control functions in the drift term of (ET), which is the main concern 
in the next section. 


6.2 Control System With a Control in the Drift Term 


In this subsection, we study a special case for which the control is only acted 
in the drift term. 
Let us consider the following special case of the system (E): 


| dy = (Ay + Bu)dt + CydW (t) in (0, T], (6.30) 


y(0) = yo. 
In (E30), u(-) € L1(0,T; L?(Q; R")) is the control variable and y(-) is the 


state. Clearly, y(-) € L2(02; C([0, T]; R”)). The exact controllability for (G30) 
is defined as follows: 


Definition 6.12. The system (G30) is called exactly controllable (at time 
T) if for any yo € R” and yı € L*. (Q; R”), there exists a control u(-) € 
Li(0,T; L?(2; R")) so that the corresponding solution y to (G30) verifies 
that y(T) = yi, a.s. 


Let us first show the following preliminary result. 


Theorem 6.13. Let H be a Hilbert space and p € |l,oo). For any & € 
L5. (Q; H), there is an f € Lp(0,T; LP (Q; H)) such that 
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T 
ef f(t)at (6.31) 


and 
|f C)eEzitomizo (9:8) S llez (o (6.32) 
Proof: For any p € [1, oo), define an operator Lr : L1(0, T; LP (2; H)) ^ 
L5 (2; H) by 


T 
LLUO) =f foa, V FO e IHO, T; ros. 
0 
Clearly, to prove (KL3I), we only need to prove that 
R(Lr) = L5. (0; H). (6.33) 


Note that (Z5. (2; m) = 1» (Q; H), where p' denotes the Hólder conju- 
gates of p, and, by Theorem ETA, 


(LECO, T; L? (0; H))) = LẸ (0, T; L” (2; H)). 


Hence, in order to prove (KL33) and (632), by Theorem L, it suffices to 
derive the following inequality: 


[Linn] ree (o;r;z»' (3H) Z Ilez (oun): VE LE, (2; H). (6.34) 


In order to prove (6.34), let us first find the dual operator Lj. of Lr. For 
any f(-) € L$(0, T; L?(Q; H)), and n € LP. (Q; H), we have 


(Lr fn) LE, (05H),L5. (3H) 












































= uu f(0dt,n) -f s mado f E(f (t), E(n | Fr) udt. 


0 


Consequently, L% : I5. (9; H) > LẸ (0,T; L” (N; H)) is given by 














(Lin)(t) =E | A), ae tE [0T], Yn E DE (2H). (6.385) 
For p > 1, making use of (E38), we find that 
ms 


onl is(o.r.te" tomy = (sup EEG | F2)" 
TN Le (0,T;L»' (Q;H)) a | t p 


> (EEO | Fo)” = (€ 


Therefore, (34) holds for p > 1. 




















i 
7 


n|? ) NH ses Ilis (or) 
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Next, for p — 1, we have that 














[L| ree (0,T;L99(Q;H)) = id (ess sup we o[E( | Flu) 
efo, 











2 ess sup wen (IIE(n | Fr)|a) = esssup veoln(o)la = Inlzs, (2m) 





This implies that (KL34) also holds for p = 1. LI 


Remark 6.14. Theorem is also true when H is a Banach space having the 
Radon-Nikodym property. We refer the readers to [239, Theorem 3.1] for the 
proof. 


By Theorem 614, it is easy to show that the system (KL3U) is exactly 
controllable whenever C = 0 rank B = n. Generally, we have the following 
result. 


Theorem 6.15. System (G30) is exactly controllable if and only if 
rank B — n. 


Proof: The *only if" part. We use the contradiction argument. If 
rank B < n, then there would exist an 7 € R” with |n|re = 1 such that 
n' B = 0. Let € € L3 (9) be the random variable given in Proposition 
and put y; = £r. Since the system (KL3Ul) is exactly controllable, one can find 
a control u € L1(0, T; L? (2; R")) such that 


T T 
£y = yo +f (Ay(t) + Bundt f Cy(t)dW (t). (6.36) 


Multiplying both sides of (E30) by n! , we obtain that 


T T 
e NE f n" Ay(t)dt + f 1" Cy(t)dW(t), 


which contradicts Proposition 6.2. 


The *if" part. Similarly to the proof of Theorem (for *1)«—2)"), 
it suffices to consider the special case that the initial datum yo in the sys- 
tem (Ki3U) is equal to 0. We define an operator G : Ll(0,T; L?(Q; R")) > 
L*. (Q5; R") by 


G(u()) 2 (T), Vu() € L&(0, T; L(2; R")), (6.37) 


where y(-) is the corresponding solution to (G:3U) with yg = 0. We need to give 
an explicit form of the dual operator G* : L7. (Q; R^) — LẸ (0, T; L?(Q;R™)). 
For this purpose, we introduce the following backward stochastic differential 
equation: 
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"EZ" T in 
Pa (A' z(t) +C? Z(t))dt + Z(t)AW (t) in [0,T), (6.38) 


2(T) = 2, 
where 21 € L*. (Q; R”). Clearly, the equation (E39) admits a unique mild 


solution (z(-), Z(-)) € L2(0; C([0, T]; R”)) x L2(0, T; R”). Applying Itó's for- 
mula to (E30) (with yo = 0) and (238), we obtain that 


























T 
E( y(T), 23 Jgn = Ji ( Bu(t), z(t) )pndt, Vz€ L5. (Q; R”). (6.39) 


where (z(-), Z(-)) solves (238). By (637) and (€39), it is clear that, 
(G*z1)(t) = B'z(t), a.e. t€ [0,7]. (6.40) 
Now, the exact controllability of (&30) is equivalent to that 
R(G) = L}, (2; R”); 


while the latter, by (KC4U) and using Theorem L (with G defined by (G18) 
and F being the identity operator in L3} (f2; R")), is equivalent to that all 
solutions (z(-), Z(-)) € L2(0; C([0, T]; R?)) x L2(0, T; R”) to (E38) satisfy the 
following estimate: 


lal rz, coin) < C|B' z|rz-(o,r;z2(0;Rm)); V z1 € L (2; R”). (6.41) 


Now, by rank B = n, z() € L2(02; C([0, T; R")) and the second equation 
n (6.38), the desired estimate (G41) is obvious. This completes the proof of 
Theorem ETA. L1 


Remark 6.16. Fix any q € [1,2). By means of Theorem GIJ, we may give 

another “proof” of the "if" part in of Theorem ETAS. Indeed, without loss 

of generality, we assume that B € R"*". Fix any yı € L*. (05 R”). Since 
2+4 

S(T)! (yı — 9(T)yo) € LZ. (0; R"), it follows from Theorem that there 


2+4 


is an f € LA(0,T;L= (2;R")) such that 


T 
&(T) (yi — 9(T)w) = f f(s)ds. (6.42) 


Here &(-) is the solution to (ELT3) with A(t) = A, d = 1 and C\(t) = C 
Let u(-) = B~'®(-)f(-). It is easy to see that u(-) € Lz(0,T; L4(£2; R")). 
By Theorem EA, we have that 


T 
y(T) = &(T)yo + an) | $(s) Bu(s)ds = yi. (6.43) 


Hence, we conclude the exact controllability of the system (6.30) provided 
that the control class is chosen as follows: 
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us {u(-) € Le(0, T; L* (2; R")) | The corresponding solution to 


(6.44) 
(G30) with yo = 0 satisfies that y(T) € D, (0; R")). 


In this case, u(-) € U and y(-) are respectively the control and the state 
variables for the system (30). Then, clearly, y(-) € L2(02; C([0, T]; R")). 
Note that, in the above “proof”, q cannot be chosen to be 2, and therefore, 
the control class U is a proper subset of L4(0,T; L?(2;R™)). 


Next, we show that, for any r € (1,00) and p € (1,00), the system (E30) 
with C = 0 and m = m is not exactly controllable if the control class is 
chosen to be LF(0, T; LP(2; R")). For simplicity, we only consider the case 
that m — n — 1. 


Theorem 6.17. For any r,p € (1,00), there exists an ņ € Lr. (£2) such that 
for any f € Ly(0,T; LP ((2)), 


T 
nz f f(t)dt. (6.45) 


Proof: For any r,p € (1,00), define an operator Ly : LẸ(0, T; L°(2)) 2 
Lz (2) by 


T 
Ln(f() = 1 fedt, Y fC) € L5 (0, T: L7(0)). 


Denote by r’ and p’ the Holder conjugates of r and p, respectively. Similarly 
to (G35), by Theorem L73, L5. : LE (2) ^ Li (0, T; L” (Q)) is given by 














(Li) =E(n| Fi), aete[T, VneDz.(0). ^ (646) 

Let us use the contradiction argument to prove Theorem ETA. If there was 

an r € (1,00) so that R(Lr) = L/ (02), then, in view of Theorem CI, we 
could find a constant C > 0 such that 


PT < CILIN p» 0,T;1r (2): YE L£.(02). (6.47) 


Consider a sequence of random variables {1, }°°, defined by 
p 
m = f e"! dW (t), nc N. 
0 


It is obvious that rj, € 1 (2) for any n € N. By Theorem 2.123, the integral 


e2nT 1 
2n ^" 





T i . ; l ; 
Jo €"* dW (t) is a Gaussian random variable with mean 0 and variance 
Hence, 
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T /. d oo p 2 ES 

p T TEIL "E nc 7 

f caw (b) ) a | vell (2 nT da] P 
ó E /(e2nT — l)r 


PRU INP aP ES 
_ [J (f) lel s da)” — (648) 
E n vm 


AL 
1 oo y p7 2nT _ 1 
= (= | |x|? ear)" gcc 
Vr —oo TL 


Now, by (K28), it is easy to see that 





m 


vi 











Lem 
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[ etawa) = 





n 














Maliz (y _ ( 
































a ee 5 [T (6.49) 
P ,—c 
= (= f ||” e i) —— 
Using (KL48) again, we have 
r d ys 44 
Btn lana =| i (E fi e"dwr) )"at 
0 0 
T 66 1 r' vl 
1 1 d. 2nt _ 1 
= f Gs |x|? eda) a“ dt 
T J oo n 
d (6.50) 
1 ( 1 - 7 la 
< —(— |x|? e7” dx) (f ent dt) 
n vm —oo 0 
1 1 oo I nT 
<| al ear)” —À 
n \VT J- nr’) 

















[EC | 2| r^ (o rco (e) z 


Tren Moles (y ~ noo (nr!) vVe2nT — 1 








This, combined with (46), gives 





Linn pf. Fal 
lim | Lg (0,T;LP (2)) E 0, 
noo 





Mol eet (o) 


which contradicts the inequality (KL47). This completes the proof of Theorem 
E TA. o 


Remark 6.18. At this moment, it is unclear whether the same result in Theo- 
rem ET holds for p = 1 or not. 
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For any r € [1,00), let us “embed” the controlled ordinary equation (LI) 
with m = n into our stochastic setting, i.e., we consider the following con- 
trolled stochastic differential equation: 


l dy = (Ay + Bu)dt in [0, T], 


6.51 
y(0) = Yo, 


where A € R?*", B € R?*", u(-) € LE(0, T; L?(Q;R”)) is the control variable 
and y(-) € L2(0; C([0, T]; R")) is the state variable. Similarly to Definition 
EIZ, the system (51) is called exactly controllable (at time T) if for any yo € 
R” and yj € L}, (Q;R”), one can find a control u(-) € LẸ(0, T; L?(Q;R")) 
such that the corresponding solution y to (G51) satisfies y(T) = y1. Then, as 
an easy consequence of Theorems EIA and ETA, the following result holds: 


Corollary 6.19. The system (G51) is exactly controllable if and only if 
rank B — n and r — 1. 


To the best of our knowledge, unlike the deterministic case, so far there 
exists no universally accepted notion for stochastic controllability, even for 
stochastic differential equations in finite dimensions. Motivated by Theorem 
6.15 and Corollary G19, we introduced a corrected formulation for the exact 
controllability of the system (EI) as follows: 


Definition 6.20. The system (€T) is called exactly controllable if for any 
yo € R” and yı € L} (2; R"), one can find a control u(-) € L$(0, T; R™) so 
that Du € CT T; R”) and the corresponding solution y(-) to (€T) satisfies 
y(T) = y1, as. 


Remark 6.21. Clearly, the control class in Definition is the biggest one so 
that the solutions to (€I) make sense. 


The above definition seems to be a reasonable notion for exact controlla- 
bility of stochastic differential equations. Nevertheless, a complete study on 
this problem is still under consideration and it does not seem to be easy, even 
for the very simple case when n = 2. 

On the other hand, from Corollary KLIH, it is easy to see that exact control- 
lability seems a too strong controllability requirement for stochastic evolution 
equations. Naturally, people hope to see what happens if such a controllability 
requirement is weakened, say to be null/approximate controllability, which is 
the main concern in the next section. 


6.3 Lack of Robustness for Null/Approximate 
Controllability 


In this section we shall show the lack of robustness for null/approximate 
controllability for stochastic differential equations. 
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We begin with the following two notions of controllability for the system 


Definition 6.22. The system (€T) is called null controllable (at time T) if 
for any yo € R”, there exists a control u(-) € L1(0,T; L?(2; R") so that 
Du € L0 R”) and the corresponding solution y(-) to (ECT) satisfies 
y(T) — 0, a.s. 


Definition 6.23. The system (€T) is called approximately controllable (at 
time T) if for any yo € R^, y € L*. (0; R”) and € > 0, there exists a 
control u(-) € L$(0, T; L? (2; R") so that Du € Im R”) and the cor- 
responding solution y(-) to (CT) satisfies that y(T) € L*-.(;R") and that 
ly(T) — Vili, (2R) <E. 


To show the lack of robustness for null/approximate controllability for 
(G1), we consider the following very simple stochastic control system (in two 
dimensions): 

dii = yodt + €yodW (t) in [0, T], 


dyz = udt in [0, T], (6.52) 


yı(0) = y10, Y2(0) = yo; 


where (y10,Y20) € R?, u(-) € L1(0, T; L?(2)) is the control variable, £ is a 
parameter. 

Clearly, if € = 0, then (652) is null controllable for any T > 0. However, 
this system is NOT null controllable anymore whenever £ Æ 0. To see this, we 
use the contradiction argument. Assume that there was an €9 > 0 such that 
for all € € [—€0,€0] and T > 0, (@52) would be null controllable. Let us take 
yio = 0, yoo = 1, € = £o and T = ES By the null controllability of (E52) at 


2 
T = 2, we have 








2 2 
ony £0 


e 7 E 
n(2) = f yodt +eo f yodW (t) =0. 
0 0 


Thus, 











m 




















ya |^ dt. (6.53) 














$ 2 $ 
eo | ydW (0) >a] E 
0 0 
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= al «xl [^ idt ? wPar)| « £8 E 
[vn se m) wr f 
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"a 2 
i yodt| =E 
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On the other hand, 
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yol^dt. (6.54) 
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e2 
It follows from (E33) and (E54) that ni E|y»|?dt = 0, which contradicts the 
choice of y2(0). 
Next, we consider the approximate controllability of (K52). For this pur- 
pose, we introduce the following backward stochastic differential equation: 


dz = Z,dW (t) in (0, T], 
dz = —(zi + eZ, )dt + Z2dW (t) in (0, T], (6.55) 
a(T) = zr, 22(T) = zar, 


where (zır, zzr) € L.. (2; R?). We define an operator £ : L&(0, T; L?(2)) > 
L*. (0; R?) by 


£(u()) =(w(L),y2(T)), V ulf) € Epl, T; L^ (0), (6.56) 
where (y1(-), y2(-)) is the corresponding solution to (G52) with yi9 = yoo = 0. 


Then, applying Itó's formula to (652) (with yio = yao = 0) and (E53), we 
obtain that 














T 
(Gs T) (T) Giro) Yea, cage) =E f weno 


V (air, Zar) € L3- (2; R°). 


(6.57) 


By (E38) (E-572), it is clear that, £* : LZ, (2; R?) > LX (0, T; L?(Q)) is given 
as follows: 
(L* (zr, zor))(t) = z(t), ae.. tE (0, T]. (6.58) 


Obviously, the system (KL52) is approximately controllable at time T if and 
only if R(L) = L*.. (0; R?). Hence, by Theorem ILTA, the approximate con- 
trollability of (652 =) is equivalent to the following observability property for 
(solutions to) (G55): If za(-) = 0 in (0, T), then zır = zor = 0, a.s. 

If € = 0 and z3(-) = 0, then by the second equation in (E9), we obtain 
that 





alt=- [ eye f zia) =o. Ytelo,T]. (659) 


By Itó's formula, we see that 














(T)? -E 




















T 
(0)? = |Zs(s)ds = 0, (6.60) 


which implies that Z(t) = 0 for a.e. (t,w) € [0, T] x 2. Thus, it follows from 
ep that [^ z1(s)ds = 0 for any t € [0, T]. This concludes that z,(t) = 0 for 

e. (t,w) € [0, T] oe Then, by (z1(-), z2(-)) € L2(2; C([0, T]; R2)), we deduce 
us Zip = 22T = 0, a.s. Therefore, we conclude that (£52) is approximately 
controllable if € = 0. 


226 6 Controllability for Stochastic Differential Equations in Finite Dimensions 
However, if € Z 0, then it is easy to check that 


Ga (t), za (t), Zi (t), Z2(t)) 
e (ex { = zi] 0, E UM za b0) 
(E53 


) with the final datum 





is a nonzero solution to 





ae ede) 


(zT, Zar) = (exp { 


Hence, the above observability property for ((&55) does not hold. Therefore, 
(G52) is not approximately controllable whenever & Æ 0. 


Remark 6.24. By the above two examples, we deduce that both null and ap- 
proximate controllability for stochastic differential equations in finite dimen- 
sions are unstable under small perturbations. This differs significantly from 
the controllability properties for deterministic problems. Note that, a simi- 
lar phenomenon was firstly observed in [ZIJ] for control systems governed by 
stochastic parabolic equations (See also Section E3). 


6.4 Notes and Comments 


Except Theorem 610 (which was communicated privately to us by Qida Xie), 
the results in Section EJ were first proven in [275] (See also [248, Section 3] for 
a slightly different presentation). The results in Section are modification of 
that in [239]. Section EJ is taken from [246]. We refer to (13, 20, 61, 125), 127, 
(141, B47, B48, 876, B82] for some other controllability results on stochastic 
differential equations in finite dimensions. 

Compared to stochastic optimal control theory, the controllability theory 
for stochastic differential equations is surprisingly far from satisfactory, even 
for the case in finite dimensions. Actually, in our opinion (as remarked in 
(246]), compared to the deterministic case, the controllability /observability 
for stochastic differential equations (even in finite dimensions) is still at its 
enfant stage. There are numerous works which remain to be done, for example: 


e Generally speaking, when n > 1, the exact /null/approximate controllabil- 
ity for the linear system (ET) (in the sense of Definitions K-20, and 
EZA) are far from well-understood; 

e In the deterministic setting, at least for the case of finite dimensions, con- 
trollability is closely related to another important notion in Control Theo- 
ry, i.e., stabilization. It seems that so far there exist no studies on stochastic 
stabilization via controllability; 

e It is well-known that, the classical controllability theory for the deter- 
ministic setting is the basis for linear filtering and prediction problems 
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( (162, 1163]. Now, since the stochastic controllability theory is completely 
unsatisfactory (as mentioned above), it seems quite interesting to revisit 
the corresponding filtering and prediction problems; 

Similarly to the deterministic setting ([I9'7, B50]), it would be quite inter- 
esting to give topological classification of stochastic linear control systems, 
at least for the relatively simple system (K.II) but, as far as we know, no 
results have been published for the stochastic problems; 

To the best of our knowledge, there exist no nontrivial results about the 
controllability of stochastic nonlinear control systems. It would be quite 
interesting to give some Lie bracket conditions (as people did for the de- 
terministic setting, e.g., [GT, BO) for stochastic controllability problems, 
again at least for the nonlinear version of the relatively simple system 


(E). 


f 


Check for 
updates 
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Controllability for Stochastic Linear Evolution 
Equations 


This chapter is devoted to presenting some results on controllability for for- 
ward and backward stochastic linear evolution equations with possibly un- 
bounded control operators. By the duality argument, these controllability 
problems can be reduced to suitable observability for the dual equations. 
Explicit forms of controls for the controllability problems are also provid- 
ed. Finally, the controllability of some forward stochastic evolution equations 
are shown to be equivalent to that of suitably chosen backward stochastic 
evolution equations. 


7.1 Formulation of the Problems 


The (F, ’)-controllability concept introduced in Definition EA (in Section 
of Chapter El) is quite general, which is very hard to be studied (even in the 
deterministic setting and in finite dimensions). In this chapter, we shall fo- 
cus mainly on exact /null/approximate controllability problems for stochastic 
linear evolution equations in the abstract setting. 

Throughout this chapter, H, V and U are three Hilbert spaces which are 
identified with their dual spaces, £9 2 L(V; H), and A is the generator of a 
Co-semigroup (S(t)hso on H. In this chapter, H and U will serve as respec- 
tively the state and the control spaces for the systems under consideration 
unless other stated. 

For any fixed T > 0 and a control operator B € £(U; H), we begin with 
the following deterministic controlled evolution equation: 


l yilt) = Ay(t) + Bu(t) in (0,T], 


(7.1) 
y(0) = yo, 

where yo € H, y is the state variable, and u(€ L?(0,T;U)) is the control 

variable. The exact/null/approximate controllability of (£I) can be defined 
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as that in Definition EU. For example, the system (ET) is called exactly (resp. 
null) controllable at time T' if for any yo, yr € H (resp. yo € H), one can find 
a control u € L?(0, T; U) so that the corresponding solution to (LI) verifies 
y(T) = yr (resp. (T) = 0). 

Similarly to the equation (LZA) for the exact controllability of (IL T), peo- 
ple introduce the following dual equation (of ([1)), which is a (backward) 
equation evolved in H: 


| zt = —A*z in [0, T), (7.2) 


2(T) = zr. 
One can show the following result. 


Theorem 7.1. The following statements hold: 
1) The system (CT) is exactly controllable at time T if and only if solutions 
of (C2) satisfy 


T 
lerla € c] |B*z(t)?dt, Ver €H; (7.3) 
0 


2) The system (CI) is null controllable at time T if and only if solutions 
of (L2) satisfy 


T 
lz(0)|g < c |B*z(t)|?dt, Ver eH; (7.4) 
0 


3) The system (CT) is approximately controllable at time T if and only if 
solutions to (I2) enjoy the following property: 


B*z(-) 2 0 in (0, T) > zr = 0. (7.5) 


The proof of Theorem C] can be found, say, in that of [377, Theorems 
2.4-2.6 of Chapter 2]. 


Remark 7.2. 1) It is easy to see that, when A generates a Co-group {5(t)}ier 
on H (hence both (1) and (C2) are time reversible), the estimates (C3) 
and (EJ) are equivalent, and therefore in this case the exact controllability 
and null controllability for the deterministic system (£T) are equivalent. At 
the end of this section, we shall see that this is NOT true anymore in the 
stochastic setting. 

2) From (CA) and (3), it is clear that, if the dual equation (L2) enjoys 
the following property: 

z(0) 202 zr — 0, 


then, the null controllability of (CI) implies the approximate controllability 
of the same system. This is the case, for example, for deterministic parabol- 
ic equations. However, as we shall see in Chapter B, this is NOT true for 
stochastic parabolic equations (See Theorems E-77 and EY for more details). 
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A main goal in this chapter is to extend Theorem ÆC] to the stochastic 
setting. For this purpose, suppose that (£2, F, F, IP) (with F = {Fi }1e[0,7)) isa 
fixed filtered probability space satisfying the usual condition. Let {W (t) e(o,T] 
be a V-valued, F-adapted, standard Q-Brownian motion (with Q being a given 
positive definite, trace-class operator on V) or a cylindrical Brownian motion 
on (Q, F, F, P). Denote by F the progressive o-field (in [0, T] x (2) w.r.t. F. In 
the sequel, to simplify the presentation, we only consider the case of cylindri- 
cal Brownian motion and FF is the corresponding natural filtration (generated 
by W(-)). Also, in the rest of this chapter, to simplify the notation, we write 
Ur 2 L2(0,T;U). 

We consider the following forward stochastic control system evolved in H: 


dy(t) = (Ay(t) + F(t)y(t) + f(t) + Bu(t))dt 
+(G(t)y(t) + Du(t)) aW (t) in (0, T], (7.6) 
y(0) = yo, 


where F € Lg? (0, T; C(H)), f € L2(0; L1 (0,T; H)), G € LX (0, T; £(H; C9)) 
and D € L(U; £9). In (ZB), vo(€ H) is the initial state, y is the state variable, 
and u(€ Ur) is the control variable. By Theorem ETA, the system (ZG) admits 
a unique mild solution y(-) € Ce([0, T]; L2(2; H)). 

Some notions of controllability of (ZG) are given as follows: 


Definition 7.3. 1) System (CU) is called exactly controllable at time T if 
for any yo € H and yr € L*. (f2; H), there exists u € Up such that the 
corresponding mild solution to (CH) satisfies y(T) = yr a.s. 

2) System (LH) is called null controllable at time T if for any yo € H, 
there exists u € Ur such that the corresponding mild solution to (CE) satisfies 
y(T) — 0 as. 

3) System (CU) is called approximately controllable at time T if for any 
yo € H, yr € LA, (0; H) ande > 0, there exists u € Ur such that the 
corresponding mild solution to (CH) satisfies |y(T) — Vrlia, (23H) <e. 


In view of the conclusion 1) in Proposition and also motivated by the 
controlled backward stochastic differential equation (13), we introduce the 
following controlled backward stochastic evolution equation: 


dy(t) = — A*y(t)dt + (J(t)y(t) + KEY (t) + g(t) + Bu(t))dt 
Y (t)dW (t) in (0,7), (7.7) 
y(T) = YT, 


where J € L&°(0,T;L(H)), K € LZ (0, T; C(£C9; H)) and g € L2(0; L' (0, T'; 
H)). In (ŒD), yr(€ Lz. (2; H)) is the final state, y and u(€ Ur) are viewed 
as the state and control variables, respectively. By Theorem ELTU, the sys- 
tem (C1) admits a unique mild solution (y(-), Y (J)) € L2(02; C([0, T]; H)) x 
L$(0. T; £2). 
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Similarly to Definition [23, some notions of controllability of (A) are 
introduced as follows: 


Definition 7.4. 1) System (CI) is called exactly controllable at time 0 if for 
any yr € L*. (f2; H) and yo € H, there exists u € Up such that the corre- 
sponding mild solution to (CI) satisfies y(0) = yo. 

2) System (CI) is called null controllable at time 0 if for any yr € 
L*.. (12; H), there exists u € Ur such that the corresponding mild solution 
to (CI) satisfies y(0) = 0. 

3) System (LL) is called approximately controllable at time 0 if for any 
yr € L5. (2; H), yo € H and € > 0, there exists u € Up such that the 
corresponding mild solution to (ICA) satisfies |y(0) — yola < €. 


As that in the deterministic setting, for control problems of stochas- 
tic partial differential equations, there are many cases that the control op- 
erators are unbounded, say the Dirichlet boundary controls for stochastic 
wave/heat/Schródinger equations. For such kind of problems, one cannot ob- 
tain the existence of the H-valued mild solutions to (A) or (CA). Neverthe- 
less, as we shall see in the next section that, when the control operators have 
some further property, one can show the well-posedness of the corresponding 
control systems in the sense of transposition solutions. 

In the rest of this chapter, O is another Hilbert space which is dense in 
H and denote by O’ its dual space w.r.t. the pivot space H. Hence, O C 
H = H’ c O’. Let A generate also a Co-semigroup {S(t)}i>0 on O and O’, 
respectively. Denote by H_; the completion of H w.r.t. the norm 


A = 
|z|z_, =|(61 — A) "ax, 


where £ is a fixed real number which belongs to the resolvent set of A. We fix 
two unbounded operators B € L(U; H_1) and D € L(U; L2(V; H_1)). 

Similarly to (2G), we consider the following forward stochastic control 
system evolved in the state space O’: 


dy(t) = (Ay(t) + F(t)y(t) + £(t) + Bu(t)) dt 
+(G(t)y(t) + Du(t)) dW (t) in (0,77, (7.8) 
y(0) = Yo; 


where F € L&(0,T;L(O')), £ € L2(Q;L1(0,T;O’)) and G € Lg? (0, T; L(O’; 
L(V; O^))). In (ŒX), yo € O' is the initial state, y is the state variable, while 
u(€ Ur) is the control variable. 
Also, similarly to (ZZ), we consider the following backward stochastic con- 
trol system evolved in the state space O’: 
dy(t) = —A*y(t)dt + (T(t)y(t) + KEY (t) + g(t) + Bu(t))dt 
+Y (t)dW (t) in [0, T), (7.9) 


y(T) = yr, 
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where J € LẸ (0,T; £(O^)), K € Le (0,T;L(L2(V; 0’); O’)), g € LE(0,T; 
L?((2; O")). In (ZY), yr(€ L7. (2; O')) is the final state, y and u(€ Ur) are 
viewed as the state and control variables, respectively. 

Clearly, unlike that in (ZG) and (£7), the control operator B in both (EX) 
and (C9) and the control operator D in (ICX) are allowed unbounded. As we 
shall see in the next section, under some assumptions, the systems (LA) and 
(C9) are well-posed in the sense of transposition solutions, in the solution 
spaces Cr([0, T]; L2((2; O')) and Ce([0, T]; L?((2; O^)) x L2(0, T; £2(V; O^), 
respectively. 

The notions of controllability for the systems (CX) and (£9) can be defined 
very similarly to that for (IZ) and (CA) (The only two differences are to 
replace the Hilbert space H and mild solutions used Definitions and L4 by 
the Hilbert space O' and transposition solutions, respectively), and therefore 
we omit the details. 


Remark 7.5. 1) In the system (£U) (and also (ICN)), the control u enters in 
both the drift and diffusion terms. This is natural in the stochastic setting. 
Indeed, as we shall see in the Chapters BHIT (see also that in the last chapter), 
for many stochastic controllability problems, people have to introduce controls 
in this way. On the other hand, even if in some case it is enough to have only 
one control in the drift (or diffusion) term, this control may affect the diffusion 
(or drift) term one way or another. 

2) In view of Definition EZO, it is more natural to replace the control 
class Ur employed in the definition of controllability for the system (LA) 
(resp. ((Z8)) by the set {u € LŁ(0,T; U) | Du € TŽ? (0,T; £9)) (resp. {u € 
Li(0,T;U) | Du € LẸ" (0, T; La(V;0'))}). Nevertheless, so far it seems 
difficult to obtain useful results using such a control class. 

3) The control operator D in (EX) is also allowed to be unbounded. Com- 
pared to the deterministic problems, this is completely new for the stochastic 
setting though the analysis for concrete problems remains to be done and 
there might exist some essential difficulties. 


In the sequel, the controllability for the forward (resp. backward) stochas- 
tic evolution equations (L0) and (CX) (resp. (CA) and (ZY)) are simply re- 
ferred to the forward (resp. backward) controllability. In the deterministic 
setting, it is easy to see that any backward controllability problem can be re- 
duced to a forward one by simply reversing the time variable. However, such 
a technique does not work anymore for stochastic problems because of our 
adapted-ness requirement on stochastic processes, and therefore one has to 
analyze the forward and the backward controllability separately. 

In the rest of this section, we shall present more new phenomena for the 
controllability problems in the stochastic setting. For simplicity, we only con- 
sider the case of bounded control operators and the special case that V = R, 
i.e., W(-) is a one dimensional standard Brownian motion. 

First, as a simple generalization of the conclusion 1) in Proposition K-3, we 
have the following necessary condition for the exact controllability of (LG). 
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Proposition 7.6. If f(-) € L2(0, T; H) and G(-) € Cz([0, T]; L^? (2; £(H))) 
and the system (CH) is exactly controllable at time T, then 


D(A*)n R(D)- - 0. 


d 
Proof: We use the contradiction argument. Assume that D(A*)YR(D) z 
Ø. Then, we could find v € D(A*) with |g|g = 1, such that (Dv, y) g = 0 for 
any v € U. Hence, for any u € Ur, by (ZH), 


(y(T), c) n — (Yo, P) H 


T 
- f (U(E), A p) + (FOYE) + f(t) + Bult), e) x) at (7.10) 


T 
+ f E E 
0 


T 
Let us choose yo = 0 and yr = (f n(t)dW (t)) 9, where n(-) is given by 
0 


(G2). Then, by the exact controllability of the system (CU) at time T, it 
follows from (L10) that, for some u € Ur, 


m T 
y n(t)dW (t) = | (y(t), A"o) ar + CF) + F0) + Bult), o) wat 


T 
+f (Ow. eave, 
0 
(7.11) 
Since y(-) € Cg([0, T]; L7(Q; H)) and u(-) € Ur, we see that 


(y(-), A*g)n + (FO) + fC)  BuC),9)n € LRO, T) 


and (G(-)y(-), v) u € Ce([0, T]; L2((2)). Hence, it is clear that (LII) contra- 
dicts Proposition BA. Oo 


Remark 7.7. By Proposition [LA (See also the conclusion 1) in Proposition 
E3), we see that, in order that the system (CE) is exactly controllable at time 
T, one has to choose the control operator D in the diffusion term of (£) 
to be sufficiently "effective" (or even active everywhere in some sense). This 
is because, in the stochastic setting, the “target” set (i.e., L3 (2; H)) is too 
large, compared with the set of initial state (i.e., H). 


Next, we consider the following control system with deterministic coeffi- 
cients: 


l dy(t) = (Ay(t) + F(t)y(t) + f(t) + Bu(t))dt + G(t)y(t)aW(t) in (0, T], 


y(0) = yo 
(7.12) 
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and its deterministic counterpart: 


a = AQ (t) + F(t)g(t) + f(t) + Bü(t) in (0, T], (7.13) 
$(0) = yo; 


where yo € H, F € L*(0,T; £(H)), f € L?(0,T; H) and G € Lg*(0,T) 
(Clearly, any G € LẸ (0, T) can be viewed as an element in LẸ (0, T; C(H))). 
In (CTY) (resp. (CIJ), y (resp. ĝ) is the state variable and u € Ur (resp. 
& € L?(0, T; U)) is the control variable. 

We have the following simple result: 

Proposition 7.8. The system (CTA) is null controllable at time T if and only 
if so is the system (CIJ). 

Proof: The “only if? part. For arbitrary yo € H, let u(-) € Ur be a 
control which transfers the state y(-) of (CIZ) from yo to zero at time T. 
Then, clearly, Ey is the solution to ([T3) with control Eu. Since y(T) = 0, 
a.s., we see that Ey(T) = 0, which implies that (CTA) is null controllable. 


The “if”? part. For arbitrary yo € H, let à(-) € L?(0, T; U) be a control 
which transfers the state ĝ(-) of - from yo to zero at time T. Let 






































y(t) = els GWE fo Gdg e), 
Then, it is easy to see that y(-) is the unique solution to (LTA) with the 
control u(-) = efo G(94W()—-3 f; G()*450(-). Since $(T) = 0, we see that 
y(T) = elo G(s)aW (s)- 3 Jo G(s)" as Q(T) = 0. Further, 
2 Re? fa G(s)aW (s) fg G(s)*dsqa 


e| "Mokas J^ MOT 


























'This complete the proof of c CA. Oo 


Remark 7.9. The same technique to prove Proposition cannot be applied 
to get the exact controllability or approximate controllability of the system 
(ZT). Indeed, let us assume that (I3) is exactly controllable. Put 


Ar = 2 (y( (T) | v) solves (T2) for some yo € H and 
u(-) = efo G(94W(s)- 3 Jo G(s*dsg. ) for some à(-) € L^(0, T; U)]. 
Then, by the exact controllability of (TA), it is easy to see that 
AP {elo G(s)aW (s)— $ fo G(s*ds, | yı € H}. 


Clearly, Ar # L}, (9; H) and Ar is not dense in L3 (2; H), which means 
that the system (LIA) is neither exactly controllable nor approximately con- 
trollable. By Remark EAZ, it is clear that this is significantly different from the 
deterministic setting, at least when A generates a Co-group on H. 
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7.2 Well-Posedness of Stochastic Systems With 
Unbounded Control Operators 


In this section, we shall use the transposition method to establish the well- 
posedness of stochastic control systems (L9) and (9). 

In order to define transposition solutions to (ZX), we introduce the follow- 
ing (backward stochastic) test equation evolved in O: 


l d£(t) = —(A*E(t) + F(t)*E(t) + G(t)* E(t))dt + E(t)aW(t) in [0,7), 
&(r) = Er. 
In (C), 7 € [0,T] and &- € L7 (£2; 0). 

Recall that we assume F is the natural filtration. Hence, by Theorem ELTIU, 


the equation (LIA) admits a unique mild solution (£, =) € L2(€2; C([0, 7]; O)) 
x L2(0, T; £3(V; O)) such that 


(7.14) 


(=) rato; do. 0»x 22(.7:22tv0» E CC9)l& 1, (oy: (7.15) 


We make the following additional assumptions. 


Condition 7.1 There exists a sequence {un}; C Ur such that Bun € 
L2(0, T; O") and Dun € L2(0, T; £3(V; O")) for each n € N and 


lim u,-—u inUr. (7.16) 


n—-+co 
Condition 7.2 There exists a constant C > 0 such that for any T € [0,T] 
and & € L% (3; O), the solution (£, €) to (CIA) satisfies that 


[B*E + D*E] 2 < 


Onu) Í C|E-|za. (ooy (7.17) 


Remark 7.10. When D is bounded, i.e., D € L(U;L2(V;O')), the condition 
Du, € L2(0, T; C3(V; O')) in Condition [ZI holds automatically, and the in- 
equality (LIA) in Condition is equivalent to the following estimate: 


[B*E] 20,70) = Clêr (9,0: (7.18) 


Under Condition ICA, the solutions to the system (C9) are understood in 
the following sense: 


Definition 7.11. A process y € Cg([0, T]; L?( 
solution to the system (IN) if for every T € 
holds that 


EUO E) oo = (£0). o 
=E [ (u(t), B'&(0) + D°E(t)) pdt + 


where (£, E) solves the equation (CIA). 


O^)) is called a transposition 


£2; 
(0, T] and € € L} (2;O), it 














(7.19) 








z] 
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We have the following well-posedness result for the system (CX). 
Theorem 7.12. Let Conditions [7.1] and [TĄ hold. For each yo € O' and u € 


Ur, the system (CX) admits one and only one transposition solution y € 
Cr([0, T]; L? (£2; O^)). Moreover, 
Iulesqo.mz2(2:0?) € C(|yolor + |flz2(@;110,7;07)) + lulu )- (7.20) 


Proof: Uniqueness of solutions. Suppose that there are y(-) and §(-) 
belong to Cg([0, T]; L? (2; O^)) such that (ZT) holds. Then, 


























E(y(T),€r)0",0 = E(9(T), Er)o",0; 
for all 7 € (0, T] and &- € L3} (2; O). This concludes that y(-) = g(-). 


Existence of solutions. Let {un}; C Ur be the sequence given in 
Condition [L]. Consider the following equation: 


dyn(t) = (Ayn(t) + F(t)ys (t) + £(t) + Bu, (t))dt 
+(G(t)un(t) + Du, (t)) a (0) in (0,7), (721) 
Yn(0) = yo. 
By Theorem ETA, we see that the equation (ZI) admits a unique mild so- 
lution y, € Cr([0, T]; L2(2;O’)). By Itó's formula, for each n € N, 7 € [0,7] 
and £, € LE (Q; O), we obtain that 
E(Yn(T), Soke m (yo, EO) oo 


= ef (Bun (t), £(t)) o odt + 




















Xj 




















ri (£(0, &(0), odt 
x (Dus (t), EE) evo), c.v, 0) 


=E f (v. 0,560) +D°S)) ya x f (£0). £)o, oft 
A 0 


(7.22) 






































where (£, =) solves (LIA). Therefore, for any n, m € N, it holds that 


























E (Yn (T) = Ym(T), bone = ef (un(t) E Um(t), B*E(t) F D*E (t))ydt. 
(7.23) 
Let us choose £, € L% (2; O) such that 


&|z2. (90) —1, 











i 1 
3 (us (T) m Vm (T); Zr) ono 2 alim) z Un (T)|z2. (2;0') 





These, together with (Z3) and Condition CA, imply that for any 7 € (0, T], 
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1 
glim(r) = Ym(T) [22 (2;0') 


< Jun i Un|r2(o,r;U)|B" EC) t D*E (lur 
< C|&-|r2. (9;0)l'in — Uml|ur X Clun — unluz; 


where C is independent of 7. Hence, 


lun — vmlcs(o,riz2(9;07) € Clun — wmluz- (7.24) 


By Condition [ZI it is clear that {un }92, is a Cauchy sequence in Ur. Com- 

bining this with (Zæ), we conclude that {yn}; is a Cauchy sequence in 

Cr((0, T]; L2(Q;O')). Hence, there exists y € Cg([0, T]; £7(2;O')) such that 

limno yn = y in Cp([0, T]; L?(2;0')). By letting n — +00 in (CZ) and 

noting Condition (ZI, we see that for each 7 € [0, T] and & € L4 (0; O), 

the equality (£19) holds. This indicates that y is a transposition solution to 
Choose a & € L*- (f2; O) such that 


&-|rz. (050) =1, 





" 


LH 








1 
(Y(T), Eoo > zY) mo 





These, together with (C19), imply that for any 7 € (0, T], 


1 
2 Iu(T)lza. (2;0') 


< |yolo|E(O)lo + [ulur |B*E(t) + D* E(t)|r2(.7.v) 
+|f|22(.2;11(0,7;0'))|2122(2;0((0,7];0)) 

< C|&-|r2. (0:07 (Iuolo + lulur + |flz2(2;11(0,7:07))) 

<C(|yolor + lulur + lflz2(2;22(0,7;07)) 


where C is independent of r. Hence, the desired estimate (£ZU) holds. This 
completes the proof of Theorem LIZ. L1 


Similarly, in order to define transposition solutions to (£9), for any 7 € 
[0, T], we introduce the following (forward stochastic) test equation: 


l dn(t) = (An(t) — T(t)*n(t))dt + ( -KE nE) + &())dW(t) in (7,7), 


n(T) = m, 

(7.25) 
where n. € L% (0;O) and h € LẸ(0, T; L(V; O)). By Theorem ETA, the 
equation (24) admits a unique mild solution 7 € Cr([r, T]; L? (2; O)) such 
that 
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aliti < C(In-lzs. (2,0) + I^|r2(o;r;ca(v;0))- (7.26) 


We need to introduce the following assumption: 


Condition 7.3 There exists a constant C > 0 such that for any r € |0, T], 
Nr € L*- (2; O) and h € L2(0, T; C3(V; O)), the corresponding mild solution 
n to (CZJ) satisfies that 


IB*nlzz(o, ro) € C([n-| pa. (9.0) + IPerzto;riescvio»)- (7.27) 
F FM , ) F 


Under Condition [73 the solutions to the system (ZY) are understood in 
the following sense: 


Definition 7.13. A pair of processes (y, Y) € Cr([0, T]; L?(42; O^)) x L2(0, T'; 
L2(V;O')) is called a transposition solution to the system (CY) if for every 
T € [0, T), nr € L3- (0: O) and h € L2(0, T; L(V; O)), it holds that 


























E(yr.n(T))o, o — E(y(7),7)o. o 


i T 
-E / (u(s), B*n(s)) ds +E / (g(s), (9), ads a 






































T 
+e | (Y (5) h(5)) evo £2(V;0) 95 
where n(-) solves (CZJ). 


Similarly to Theorem LIA, we have the following well-posedness result for 
the system (9). 


Theorem 7.14. Under Conditions [7.] (with D = 0) and [7-3, for each 
yr € L} (f2; O") andu € Ur, the system (ZY) admits one and only one trans- 
position solution (y, Y) € Cg([0, T]; L2(2; O")) x L2(0, T; £3(V; O')). More- 
over, 


lylee({0,7);£2(2;0')) + IY lzzto;r;zatv;o?) (rad 
< C(lyrlz2, (2:07) + |glrz(o,r;z2(0:0) + lulur). l 


Proof: The proof is very similarly to that of Theorem LIA, hence we give 
below only a sketched proof of the existence of solutions. Let {un}; C Ur 
be the sequence given in Condition C] (with D = 0). Consider the following 
equation: 


dy. (t) = —A* yn (t)dt + (J (t)ys(t) + K(0Y.(t) + g(t) + Bu, (t))dt 
Y, (£)dW (t) in [0, T), 


Un (T) = UT. 
(7.30) 
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Since F is assumed to be the natural filtration, by Theorem ELIU, the system 
(C30) admits a unique mild solution (y4(-), Y4(-)) € L2(02; C([0, T]; O^)) x 
L2(0, T; £9(V;O'")). By Itó's formula, for each n € N, r € (0,T), n € 
L*. (2; O) and h € Dz(0, T; £;(V; O)), we obtain that 




















E(yr.n(T))o, o = E(yn(T), Mr) o, o 


T T 
= f (us (s), B*n(s)), ds + f (g(s). n(s)) o, o ds (7.31) 












































T 
+E f A R M 


where n(-) solves (225). Therefore, for any n,m € N, it holds that 


























T 
B(us(7) - mlr) m) o +E f (0s) — Yal) MD rco catio? 














T 
=E | (ums) — us (5), B*n(5)),ds. 


(7.32) 
By the arbitrariness of 7, 7, and h in (C32), similarly to (C22), by Condition 
[73 we can show that 


|(Yn — Ym, Yn — Yn)les(to,Tiz2(0;07))x L2(0,T;£2(V;0")) € Clun — umluz- (7.33) 


By Condition ZI (with D = 0), it is clear that (u42?., is a Cauchy sequence in 
Ur. Combining this with (£33), we conclude that {(yn, Yn)}°2 1 is a Cauchy 
sequence in Cr([0, T]; L2(2; O")) x L2(0, T; £3(V; O')). Hence, there exists 
(y, Y) € Cr([0, T]; L?(2; O)) x L2(0, T; £3(V; O^)) such that 


lim (yn, Yn) = (y, Y) in Ce([0, T]; L? (0; O^) x Le(0, T; £2(V; O^)). 


By letting n — +00 in (3I) and noting Condition CI (with D = 0), we 
see that for each 7 € [0, T], n- € LE (Q;O) and h € L$(0, T; £2(V;O)), the 
equality (CZA) holds. This indicates that (y, Y) is a transposition solution to 

Finally, proceeding as that in the proof of Theorem LIA, we can show 
that the desired estimate (Z9) holds. This completes the proof of Theorem 
CIA. oO 


Remark 7.15. In view of Theorem E224, it seems that the regularity of the 
first component of the transposition solution (y, Y) € Cp((0, T]; L?(2; O^)) x 
L£(0, T; £3(V; O')) to the system (ZY) can be improved as y € L2(£2; C((0, T]; 
O^)) but this remains to be proved. 
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7.3 Reduction to the Observability of Dual Problems 


In this section, we shall reduce the controllability problems presented in Sec- 
tion C] to the observability of their dual problems. 

To begin with, let us introduce respectively the following dual equations 
of (CH) and (72): 


l dz(t) = —(A*z(t) + F(t)*z(t) + G(t)* Z(t))dt + Z(t)aW (t) in [0, T), 


z(T) = zr 
(7.34) 
and 
| a M a E ee Gees 
x = £o, 


where zr € L7. (2; H) and xo € H. 

By Theorem Æ, the backward stochastic evolution equation (C34) ad- 
mits a unique mild solution (z, Z) € L2((2; C((0, T]; H)) x L2(0, T; C9); while 
by Theorem BIA, the stochastic evolution equation (39) admits a unique 
mild solution z(-) € Cp((0, T]; L?(2; H)). 

For the exact controllability of (ZH), we have the following result. 


Theorem 7.16. System (ZH) is exactly controllable at time T if and only if 
(234) is continuously finally observable on [0, T] in the sense that all of its 
solutions satisfy the following (final time) observability estimate: 


lzrlzz, cou) € CIB*z + D*Zlur, V zr € LI (Q; H). (7.36) 
4. (MH) 


Proof: Clearly, it suffices to consider the special case that the initial datum 
yo and the non-homogenous term f in the system (ZG) are equal to 0. Similarly 
to the proof of “1)<>2)” in Theorem EA, we define an operator £ : Up > 
L*. (2; H) by 

£(uC)) — (T), Vul-) € Ur, (7.37) 
where y(-) is the corresponding solution to (A) with yo = 0 and f = 0. Then, 
applying Itó's formula to (ZG) (with yo = 0 and f = 0) and (C34), we obtain 
that 














q 
GTa hi (aun = Ji (u(t), B*z(f) + D* Z(t) )ydt, 


V zr € L}, (Q; H), 


(7.38) 


where (z(-), Z(-)) € L2(02; C([0, T]; H)) x L2 (0, T; C9) solves (C34). By (Z37)— 
(L3), it is clear that, 


(£*zr)(t) = B*z(t) + D* Z(t), a.e. t€ [0,T]. (7.39) 
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Now, the exact controllability of (ZG) is equivalent to that R(L) = L5. (0; H); 

while the later, by (C39) and using Theorem ILZ, is equivalent to the estimate 

(c30). L1 
Next, for the null controllability of (ZG), we have the following result. 


Theorem 7.17. System (ZG) with f — 0 is null controllable at time T if and 
only if (234) is continuously initially observable on |0, T] in the sense that 
all of its solutions satisfy the following (initial time) observability estimate: 


lz(0) € C|B*z + D*Zlu,, V zr € L3 (Q; H). (7.40) 


Proof: Similarly to the proof of Theorem LI, we define an operator £ : 
Ur > L*. (£2; H) by (C31) and an operator M : H > L}, (0; H) 


Myo = —w(T), Vyo € A, (7.41) 


where y(-) is the corresponding solution to (ZH) with u(-) = 0 and f = 0. 
Then, £* can be expressed as that in (239). On the other hand, applying 
Itó's formula to (£0) (with u(-) = 0 and f = 0) and (34), we obtain that 


G) 2r) r2. (em) = (yo, z(0)) gr, Ver = L3- (Q; H), (7.42) 


where (z(-), Z(-)) € L2(02; C([0, T]; H)) x L2 (0, T; £9) solves (C34). By (L-2])- 
(CZJ), it is clear that, 

M* zp = —z(0). (7.43) 
Now, the null controllability of (CA) is equivalent to that R(M) C R(L); while 
the later, by (743) and (C39), and in view of Theorem [C7%, is equivalent to 
the estimate (L). m 


Remark 7.18. Compared with Theorem LI, we assume that f = 0 in The- 
orem LIA. This condition is necessary. Indeed, Theorem LIÐ may be failed 
if f Z 0. Such a phenomenon has already been found in the study of null 
controllability of deterministic heat equations. 


Further, for the approximate controllability of (IZ), we have the following 
result. 


Theorem 7.19. System (ZG) is approximately controllable at time T if and 
only if solutions to (234) satisfy the following observability: 


B*z + D*Z =0 in (0,T),as. > zr =0. (7.44) 


Proof: Recall the operator £ : Ur — L3} (9; H) defined by (C37) (in the 
proof of Theorem LIA). It is easy to show that the system (LU) is approximate- 
ly controllable at time T if and only if R(L) = L7-.(2; H). Note that £* can 
be expressed as that in (£39). Hence, by Theorem LIZ, R(L) = LZ, (2; H) 
if and only if solutions to (C34) satisfy the property (C). oO 
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In deterministic setting, by Theorem [ZI], if the control operator B is in- 
vertible, then it is easy to get controllability results (especially the null and 
approximate controllability of (Z1)). The same holds in the stochastic frame- 
work for this special case. Indeed, we have the following result. 


Theorem 7.20. If B € £(U; H) is invertible, D = 0 and f = 0, then the 
system (CH) is both null controllable and approximately controllable at any 
time T > 0. 


Proof: By Theorem LIA, to prove that (ZG) (with D = 0 and f = 0) is 
null controllable, it suffices to show that solutions to (734) satisfy 














T 
|z(0)2; « C ef |B*z(t)|;dt, V zr € L}, (0; H). (7.45) 


By Theorem EL3, there is a constant C > 0 such that 











|z(0)2, < CE|z(t)|2,, Vt [0,1]. (7.46) 








Since B is invertible, we have that 
lula € C|B'yvu, Vy eH. 


This, together with (40), implies the inequality (49). 
By Theorem LIY, in order to prove that (ZG) (with D = 0 and f = 0) is 
approximately controllable, it suffices to show that solutions to (L34) satisfy 


B*z=0in (0,T),as. > zr = 0. (7.47) 


Since B is invertible, we conclude that z(-) = 0 in L2(0, T; H). Noting that 
z(-) € Cp([0, T]; L2(Q; H)), we find that zr = 0. Oo 


By Proposition [C0 it is easy to see that, generally speaking, the same 
result in Theorem does NOT hold for the exact controllability of (C8). 
Note that, this is because we choose the controls in (CU) to be L?-in time. 
The situation will be completely different if we choose L!-in time controls. 
More precisely, similarly to Definition ETAJ, we introduce the following notion: 


Definition 7.21. The system (ZG) with D = 0 is called exactly controllable at 
time T by means of controls in the space LŁ(0, T; L?(2; U)) if for any yo € H 
and yı € L}, (9; H), there exists a control u(-) € LẸ(0, T; L7(Q;U)) so that 
the corresponding solution y to (ZB) with D — 0 verifies that y(T) = y1, a.s. 


Proceeding as the proof of the “if”? part in Theorem EIS, one can show 
the following result (and hence we will not prove it). 


Theorem 7.22. If B € £(U;H) is invertible and D = 0, then the sys- 
tem (ZG) is exactly controllable at time T by means of controls in the space 
LM, T: (0; U)). 
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Similarly to Theorems LIA, LI and LIY, we can prove the following 
controllability results for the system (A): 


Theorem 7.23. 1) System (CA) is exactly controllable at time 0 if and only 
if (C33) is continuously initially observable on [0, T] in the sense that all of 
its solutions satisfy the following (initial time) observability estimate: 


Ixo|y € C|B*z|u,, Vato € H. (7.48) 


2) System (C1) with g = 0 is null controllable at time 0 if and only if 
(C33) is continuously finally observable on [0, T] in the sense that all of its 
solutions satisfy the following (finial time) observability estimate: 


Ir (Tz, (an) S CIB'vlus, V vo € H. (7.49) 


3) System (C1) is approximately controllable at time 0 if and only if solu- 
tions to (235) satisfy the following observability: 


Bex = 0 in (0,T),as. > zo = 0. (7.50) 


Now, let us introduce respectively the following dual equations of (ICA) 
and (Z9): 


dz(t) = —(A*z(t) + F(£)*2(t) + G(t)*Z(t)) dt + Z()aW(t) in [0, T), 


z(T) = zr 
(7.51) 
and 
en M RA UL MS 
x = T0, 


where zp € L3, (Q;O) and zo € O. 
Similarly to Theorems LIE, LTA and [IZ TJ, we have the following control- 
lability results for the system (CX): 


Theorem 7.24. Under Conditions [7] and [7.3, the following assertions hold: 


1) System (LX) is exactly controllable at time T if and only if (CEI) is 
continuously finally observable on [0, T] in the sense that all of its solutions 
satisfy the following (final time) observability estimate: 


Ir rà. (0:0) < C|B*z + D*Zlur, Vere€ Ly. (Q; O). (7.53) 


2) System (CX) with f = 0 is null controllable at time T if and only if 
(CED) is continuously initially observable on [0, T] in the sense that all of its 
solutions satisfy the following (initial time) observability estimate: 


lz(0)o € C|B*z + D*Zlu., V zr € Lz,(0;O). (7.54) 
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3) System (ZX) is approximately controllable at time T if and only if so- 
lutions to (ZAM) satisfy the following observability: 


B*z + D*Z =0 in (0,T),as. > zr =0. (7.55) 


Proof: The proof of Theorem is very similarly to that of Theorems 
(CIGHZTY but it is even simpler. Indeed, the only difference is to use the 
equality (TY) instead of the Itó formula to derive the duality relation. Hence, 
we only give below a proof of the conclusion 1) in Theorem ECZA. Similarly to 
the proof of Theorem [ZTG, we define an operator £ : Up > L}, (f2; O") by 


£(u()) — (T), Vul) EUr, (7.56) 


where y(-) is the corresponding transposition solution to (CA) with yo = 0 
and f = 0. Then, by (219) (with r = T) in Definition LO, using (CAI) as 
a test equation for the transposition solution to (ILA) with yo = 0 and f = 0, 
we obtain that 


E(y(T),27 org =E [ (u(t), B* z(t) + D* Z(t) ) pdt, 
V zr € L}, (02;O), 
where (z(-), Z(-)) e L2(05; C([0, T]; O)) x L2(0, T; £2(V; O)) solves (ZAI). By 
((-53)- (572), it is clear that, 
(L*zr)(t) = B* z(t) +D* Z(t), a.e. t€ [0,T]. (7.58) 
Now, the exact controllability of (ICX) is equivalent to R(L) = L}, (2; 0’); 


while the later, by (58) and using Theorem [CZ is equivalent to the estimate 
(C53). LI 
Similarly to Theorems and CZ, we can prove easily the following 
controllability results for the system (L9) (Hence we will not prove it here): 
Theorem 7.25. Under Conditions [7.1] (with D = 0) and [7.3, the following 


assertions hold: 


1) System (CA) is exactly controllable at time 0 if and only if (52) is 
continuously initially observable on [0, T] in the sense that all of its solutions 
satisfy the following (initial time) observability estimate: 

Ixolo € C|B*z|u,, V xo € O. (7.59) 


2) System (CA) with g = 0 is null controllable at time 0 if and only if 
(C52) is continuously finally observable on [0, T] in the sense that all of its 
solutions satisfy the following (finial time) observability estimate: 


Ir (Tra. (2:0) < C|B*zlur, V zo € O. (7.60) 


























(7.57) 


3) System (ZY) is approximately controllable at time 0 if and only if solu- 
tions to (C52) satisfy the following observability: 


B*x =0 in (0,T),a.s. > xo = 0. (7.61) 
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7.4 Explicit Forms of Controls for the Controllability 
Problems 


We have shown the existence of controls for exact /null/approxiate controlla- 
bility of systems (ZG) and ((Z7) (as well as systems (CX) and (ZY)), provided 
that their dual systems satisfy suitable observability properties. These results 
allow concluding whether a system is controllable but do not give any infor- 
mation about the control which drives the state to the destination. In this 
section, stimulated by the simple control formula (LA) in Theorem for the 
exact controllability of linear ordinary differential equations and also [123] 
for a systematic development on similar problems but for deterministic par- 
tial differential equations, we shall present explicit forms of controls for the 
controllability problems of stochastic linear evolution equations. Such kind of 
results not only provide variational characterizations on the desired controls 
but also serve for numerical analysis for the controllability problems. 

In the rest of this section, we fix any given f,g € L2(f2; L! (0, T' H)), 
yo € H, yr € L3} (Q; H) and € > 0. Define a functional on L*- (0; H) as 
follows: 


1 T 
der)- FE f  IB's) + D'Z (Oat — Etyr 2x) 0 Qo, 2) 
0 
































T 
+E (f(0),20))udt + eleri nuns — Vire 3,00), 
0 


(7.62) 
where (z, Z) solves (£34). Also, we define a functional on H as follows: 




















1o pT 
J2(x0) = 2 J |B*z(t)|] dt — E(x(T), yr) u + (xo. Yo) x 
: (7.63) 














T 
+E f oameni Vased, 
0 


where z(-) solves (£35). 
In what follows, we shall give the following explicit form of controls for 
exact/null/approxiate controllability of (CB): 


u(t) = B* z(t; £y) + D* Z(t; £r), (7.64) 


where (2(-; £r), Z(-; r)) is the corresponding solution to (C34) with the final 
datum zr replaced by a suitable chosen 27 € L*. (2; H), i.e., the minimizer 
of the functional Jı (+) under some assumptions. 

First, for the exact controllability of (ZG), we have the following result: 


Theorem 7.26. If the equation (734) is continuously finally observable on 
[0, T], then, among all controls transferring the state of (CH) from yo to yr 
at time T, the one given by (CBA) enjoys the minimal Uy -norm, where ĉr € 
L*. (Q; H) is the minimizer of the functional 3,(-) (defined by (CE2)) with 
& — 0. 
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Proof: Note that, in Theorem the parameter € in the functional ji (-) 
is taken to be 0. Clearly, in this case the functional j1(-) : LZ. (Q; H) > R 
is continuous and strictly convex. Since the equation (234) is continuously 
finally observable on [0, T] (Recall Theorem for the meaning of continuous 
final observability), we have 





























di(zr) 
> CE|zr [5 — Iyr|r, (oi) lel, (on) — [volg|z(0)| nu 
E f\12(.2;11(0,7;4))|4122(2;C((0,7);4)) 
> CE[zr|5 — C(lurlzz, (aH) + [yola + IfIzzcoizs qom) E erdzz, (aH): 


This implies that jJ1(-) is coercive. Hence, j1(-) admits a unique minimizer 
ĉr. By computing the first order variation of j1(-) (with € = 0), we obtain 
that, for any zr € L3 (Q; H), 














E [ (B*z(t; £r) + D* Z(t; £r), B*z(t) + D' Z(t))ydt 
$ (7.65) 


























T 
E E 2 f (F(t), «(0)) pdt. 


On the other hand, applying Itó's formula to (ZG) and (34), we obtain that 


























T 
E(y(T), zr) — (yor 2(0)) y — E | (F(t), 2() at 
(7.66) 














-E [ (u(t), B*z(t) + D*Z(t))) dt, V zr € LE, (05 H). 
0 


From (265) and (L60), if we choose the control u(-) as (64), then 
E(yr,zr)u = E(y(T), zr)u, Ver € Lz, (2; H), 


which implies that y(T) = yr, a.s. Hence, the control u(-) transfers the state 
of (ZG) from yo to yr at time T. 

Next, let us prove that u(-) is the control with the minimal U/r-norm, 
which transfers the state of (ZG) from yo to yr at time T. Choosing zr = 2r 
in (L08), we obtain that 






































T 
af |B* z(t; 2r) + D* Z(t; £7) [dt 
d (7.67) 


























qu 
= E(yr, 2r) n — (yo, z(0; 2r)) y — sf (f(t), z(t; 2r)) dt. 


Let ui(-) be another control which transfers the state of (ZG) from yo to yr 
at time T. Then, it follows from (£58) that 
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T 
E(yr,2r)u — (yo, z(0; 2r))  — J (f (t), z(t; 2r)) dt 
2 (7.68) 














T 
= Ji (ui (t), B*z(t; £p) + D* Z(t; 2r)) dt. 


Combining (L61) and (L69), we arrive at 














T' 
J |B* z(t; 2r) + D* Z(t; 2) |, dt 
0 








T 
= J (ui (t), B*z(t £r) + D* Z(t; £r))y dt 
0 








< |B*2(t; 2r) + D* Z(t; 2r) lu, lu Ol. 
which implies that |u|u,. € |ui|u,.. Hence, we complete the proof of Theorem 
CZA. LI 


Remark 7.27. Theorem provides a way to compute the control u (with 
minimal Ur-norm) which transfers the state of the system (LU) from yo to 
yr at time T, by means of the solution to its dual equation (234) with the 
final datum given by the minimizer of the functional J1(-) (with € = 0) on 
L*. (2; H). In the deterministic cases, people use numerical methods, such 
as implementing gradient like iterative algorithms, to compute such sort of 
controls (e.g., [395]). However, in the present stochastic setting, one will meet 
much more difficulties when employing similar methods to compute the de- 
sired controls, and it seems that a careful study of these problems remains to 
be done. 


Next, similarly to Theorem LZA, for the null controllability of the system 
(ZG), we have the following result: 


Theorem 7.28. If the system ([34) is continuously initially observable on 
[0, T], then, among all controls transferring the state of (CE) with f = 0 from 
yo to 0 at time T, the one given by (L-G4) enjoys the minimal Up -norm, where 
ĉr € L*. (02; H) is the minimizer of the functional 31(-) with € = 0 and f = 0. 


Further, similarly to Theorem LZA, for the approximate controllability of 
the system (LH), we have the following result: 


Theorem 7.29. If the system (34) is finally observable on |0, T], then for 

any given € > 0, among all controls transferring the state of (ZG) from yo to 

the € neighborhood of yr at time T, i.e., |y(T) — yr|ra. (Q;H) < €, the one 
T 

given by (CEA) enjoys the minimal Ur-norm, where 2r € L%,,(Q;H) is the 

minimizer of the functional Jı (-). 


Proof: It is easy to see that the functional J1 (-) : L%,.(Q;H) > R is continu- 
ous and strictly convex. We claim that it is coercive under the assumption that 
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the system (34) is finally observable on [0, T]. Indeed, choose any sequence 
{Tk} C L*. (2; H) such that 





lerra, ( (0H) — +00 as k + +oo. 


For each k € N, put 

m ZT,k 
Mp LH 
l.l, (01) 


Denote by (z(-; Žr e), Z(-; £r,)) the corresponding solution to (234) with the 
final datum zr replaced by Zr. Then, 


dim.) 
lzr.k| ra. (MH) 


demus. (Q;H) 














T 
J |B* z(t; Zr. k) + D* Z(t; Zr)|odt 


















































2 0 
c - fF " (7.69) 
—E(yr, rk) n + (yo, z(0; Zr)) a + E (f(t), z(t; £r )) ndt + € 
0 
lr lra.. (Q;H) CEN . = 
> E J |B* z(t; £r.) + D* Z(t; £r x)|r dt 
0 
-C(lurlzz, (at) + [yola + |f Izzcoizi o) t E. 
If 
T 
lim af |B* z(t; Zr.) + D* Z(t; 7x) |Z-dt > 0, (7.70) 
k—-4-oo 0 
then it follows from (£69) that 
Ji m, k) — +00 as [eTel (Q;H) >? -Foo. (7.71) 


Hence, we only need to consider the case that the left hand side of (£70) equals 
0. Since 276113, (2H) = 1 for all k € N, there is a subsequence {2r k; }721 of 
{2r k} Z] and a Zp € Lt. (2; H) such that Zr, converges weakly to Zr in 
L*. (2; H). Denote by (z(-; Zr), Z(-; £r)) the solution to (12) with the final 
datum zr replaced by Zr. By the definition of the weak solution to (C34), 
it follows that the corresponding solution z(-;Zr,4,) converges weak-star to 
alr) in E20; L®(0,T; H)). Then, 














T 
e| |B* z(t; Zr) + D* Z(t; zr)|g dt 
0 














T 
X lim : | |B* z(t; Zr.) + D* Z(t; Zr )|gdt = 0. 
0 
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Since the system (L34) is finally observable on [0, T], we conclude that Zr = 0, 
a.s. Thus, z(-; Zr) = 0. It follows from the first equality in (£69) that 


lim 3 m) 


um E ZE, 
k—-4oo |*T,k LH) 


which gives also (ZI). Hence, we prove the coercivity of j1(-). Then, 31(-) 
admits a unique minimizer ĉr. 
By computing the first variation of 3,(-), we get that 














E f (B*z(t; £r) + D* Z(t; 2r), B*z(t) + D'Z(t)),dt 
0 






































g ` &E(zr,2r)H (7.72) 
=F z — — E z d= 
(YT, ZT) H (yo, 2(0)) y ri (f(t), z(t)) adt [erlez j 


V zr € L}, (Q; H). 


On the other hand, we still have (CG). Hence, by (C72) and (C66), if we 
choose the control as (L64), then 











ez, 2 
L EOD Le celos (Q;H): Ver € L% (Q; H). 
2r za, (07) TT 

















E(yr — y(T), zr)u 


(7.73) 
By taking zr = yr — y(T), we find from (C73) that 
lur — y(T)lza, (08) Se. 


Now we prove that u(-) given by (264) is the control with the minimal 
Ur-norm, which transfers the state of the system (ZG) from yo to the £ neigh- 
borhood of yr at time T. By choosing zr = ĉr in (CØ), we find that 














T 
E | |B* z(t; ĉr) + D* Z(t; 2r)|;,at 
0 


























T 
= E(yr, 2r) 2 — (yo, 2(0; 2r)) y — J (f(t), z(t; 2r)) udt — el2r| 12, (0:2 

0 

(7.74) 
Let u1(-) be another control which transfers the state of the system (ICE) from 
yo to the £ neighborhood of yr at time T, i.e., the corresponding solution 
y(-; u1) to (ZG) verifies 
ly(T; u1) — vrlzz, (0, < € (7.75) 
T 


Then, similarly to (L69), we have 


























T 
E(y(T5u1), 2r) x — (yo, 2(0; r)) y — a | (F(t), z(t; 2)) pat 














T 
= J (ux (t), B*z(t 2r) + D* Z(t; 2r)) y dt. 
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It follows from ((Z74)—(IZ7G) that 














T 
Ji |B*z(t; 27) + D' Z(t; ĉr) | dt 














T 
< J (u(t), B*z(t; £r) + D* Z(t; 2r)),,dt 
0 














+E(yr — y(T; u1), 2r) n — Er lzz, (0,1 
P 








T 
< J (ux (t), B*z(t Zr) + D* Z(t; 2r)) ,dt 
0 








< |B'z(t; 2r) + D' Z(t; êr) |, a Oli 
which implies |uly, € |wily,. Therefore, we complete the proof of Theorem 
CZA. O 


Similarly to (64), we shall give the following explicit form of controls for 
exact /null/approxiate controllability of (CA): 


u(t) = B* x(t; ĉo), (7.77) 


where x(:;$9) is the corresponding solution to (£39) with the initial datum 
zo replaced by a suitable chosen Zo, i.e., the minimizer of the functional J2 
(defined by (ICG3)) under some unione 

Proceeding exactly as that for Theorems [726, and [/.29, one can 
prove the following result for exact/null/approxiate controllability of (1) 
(and hence we will not give the proof). 


Theorem 7.30. 1) If the equation (C33) is continuously initially observable 
on [0, T], then, among all controls transferring the state of (CI) from yr € 
L*. (2; H) to yo € H at time 0, the one given by (CTA) enjoys the minimal 
Ur-norm, where ĉo € H is the minimizer of the functional Jo(-) with € = 0. 

2) If the system (C39) is continuously finally observable on |0, T], then, 
among all controls transferring the state of (CI) with g = 0 from yr to 0 at 
time 0, the one given by (CTA) enjoys the minimal Up-norm, where $9 € H 
is the minimizer of the functional 32(-) with € = 0 and g = 0. 

3) If the system (C33) is initially observable on |0, T], then for any given 
€ > 0, among all controls transferring the state of (CD) from yr to the € 
neighborhood of yo at time 0, i.e., |y(0) — yolg < £, the one given by (CZ) 
enjoys the minimal Ur -norm, where ĉo € H is the minimizer of the functional 
32). 

Finally, for the case of unbounded control operators, using similar argu- 
ments as that in Theorems CZE, [/.Z3, and C30, one may obtain the 
explicit forms of controls for the controllability problems of the systems (EX) 
and (£9) (Hence, we will not give the details here). 
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7.5 Relationship Between the Forward and the 
Backward Controllability 


In this section, we shall present a relationship between the forward and the 
backward controllability, i.e., that for the controllability of the forward and 
the backward stochastic evolution equations. 


7.5.1 The Case of Bounded Control Operators 


In this subsection, we assume that A generates a Co-group on H, F(-), f(-), B 
and G(-) are the same as that in the system (C8). Let U be another Hilbert 
space which will serve as another control space, D € £L(U; £3) be invert- 
ible, B1 € L(U; £$) and Dı € £(U; H). We consider the following (forward) 
stochastic control system evolved on H: 


dy(t) = (Ay(t) + F(t)y(t) + f (t) + Bu(t) + Div(t))dt 
+(G(t)y(t) + Dv(t) + Byu(t)) AW (t) in (0,T], (7.78) 
y(0) = yo. 
and the following backward stochastic control system evolved on H: 
dy(t) = (Ay(t) + F(t)y(t) + f(t) + Bu(t) + DD"! Y (t))dt 
+(G(t)y(t) + Y (t) + Biu(t)) dW (t) in [0, T), (7.79) 
y(T) = yr. 


Here, y(-) is the state variable, u(-)(€ Ur) and v(-)(€ L2(0, T; U)) are the con- 
trol variables, yo(€ H) and yr(€ L%,(Q;H)) are respectively the initial and 
the final states. Since A is assumed to generate a Co-group on H, the system 
(CIX) admits a unique mild solution y(-) € L2(0; C([0, T]; H)), while the sys- 
tem (L) admits a unique mild solution (y(-), Y (-)) € L2(02; C([0, T]; H)) x 
L£(0, T; £9). In (CA), we emphasize that the control u(-) (resp. v(-)) in the 
drift (resp. diffusion) term affects the diffusion (resp. drift) term (Neverthe- 
less, if we regard (u(-), v(-)) as “one” control, then (C79) is still in the form of 
(C0). Stimulated by [275], we shall show below that the controllability prob- 
lems for the forward stochastic control system (CZA) (with “two” controls u(-) 
and v(-)) can be reduced to that for the backward stochastic control system 
(CA) (with only one control u(-)). 
For the exact controllability, we have the following result. 


Theorem 7.31. The system (CIX) is exactly controllable at time T if and 
only if the system (C) is exactly controllable at time 0. 


Proof: We fix any yo € H and yr € L4 (Q; H). 
The “only if? part. Since (C79) is exactly controllable at time T, one 
can find a pair of controls (u,v) € Ur x L2(0, T; U) such that the solution 
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to (CA) satisfies that y(T) = yr. Let Y = Dv. Then (y,Y) is the solution 
to (CA) corresponding to the final datum yr and the control u € Ur, and 
y(0) = yo. This implies that (C) is exactly controllable at time 0. 


The “if? part. Fix any yo € H and yr € LZ, (2;H). Since (C9) is 
exactly controllable at time 0, one can find a control u € Up such that the 
solution (y(-), Y (-)) € Le 0; C([0, T]; H)) x L2(0, T; £3) to (ZZ) satisfies that 
y(0) = yo. Let v = D~'Y. Then y is the solution to (CIA) corresponding to 
the initial datum yo and the controls (u,v) € Ur x Lz(0, T; U), and y(T) = yr. 
This implies that (CA) is exactly controllable at time T. o 


Next, we give the relationship for the null controllability of (CH) and exact 
controllability (C79). 


Theorem 7.32. The system (IN) is null controllable at time T if and only 
if the system (CA) is exactly controllable at time 0. 


Proof: By Theorem C3], it suffices to prove the “only if? part. Fix any 
yo € H and yr € L4, (2; H). Denote by (ij, Y) the solution to (LJ) with the 
final datum yr and the control u(-) = 0. Since (CZA) is null controllable, one 
can find a pair of controls (u, v) € Ur x L2(0, T; U) such that the corresponding 
solution ĝ to (CZA) with initial datum yo replaced by yo — (0) satisfies 9(T) = 
0. Then (y, Y) = (§ + J, Dv + Y) is the solution to (L79) corresponding to 
the final datum yr and the control u(-) € Ur obtained above for (£79), and 
satisfies y(0) = yo. This implies that (79) is exactly controllable at time 
0. LI 


Now, as an immediate consequence of Theorem L32, we have the following 
result: 


Corollary 7.33. The system (CIX) is null controllable at time T if and only 
if it is exactly controllable at time T. 


In view of Theorem [C31 similarly to Theorem LZ, the exact controlla- 
bility problem of (C79) can be reduced to a suitable observability estimate 
for the following stochastic evolution equation on H: 


[e = —(A* + F* — G*(D~')* Di)zdt — (D~')* Di xdW(t) in (0,T], 


(7.80) 
More precisely, we have the following result: 


Theorem 7.34. The system (CIX) is exactly controllable at time T if and 
only if all solutions to (CXU) satisfy the following observability estimate: 














T 
ef <CE f I - iD Beds V zo € H. 
0 
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It follows from Theorem [234 that when D, = 0, the exact controllability 
of (CTA) can be reduced to the observability estimate for a random evolution 


equation. Indeed, let us consider the following random evolution equation on 
H: 


dz * * i 
goce F*) a in (0,71, (7.81) 
x(0) = zo. 


As a special case of Theorem L34, we have the following result: 


Theorem 7.35. If Dı = 0, then the following statements are equivalent: 
1) The system (CIA) is exactly controllable at time T; 
2) All solutions to (CXI) satisfy the following observability estimate: 














T 
lols « C J |B'a(t)dt, Vay € H. (7.82) 
0 


Remark 7.36. The equation (CXI) can be regarded as an evolution equation 
with a parameter w. Since F € L°(0,T; C(H)), sometimes (C82) can be ob- 
tained by the existing observability result for deterministic evolution equation 
immediately. 


Remark 7.37. Since D is invertible, one may expect that the randomness of 
the system (L7A) can be eliminated simply by taking 


v() = -D (GC) + Bru(-)), 


and hence the system is reduced to the following controlled random evolution 
equation: 


WO — Ayo) (FE - DDE) nO +10 
+(B—D,D71B,)u(t) in (0,7), (7.83) 
y(0) = yo, 


However, this does not help us to achieve our goal to find a control to transfer 
the state of the system (C83) (or equivalently (IZ7Z8)) from a given yo to any 
given element in L7. (£2; H) at time T. Indeed, the dual equation of (C83) is 
still a backward stochastic evolution equation given below: 


l dz(t) = —[A*z(t) + (F(t) - D3D^!G())' z(t)]dt + Z(t)dW (t) in [0, T), 


z(T) = zr. 
(7.84) 
By Theorem LIH, the system (L83) (and hence (ILZA) ) is exactly controllable 
at time T if and only if solutions to (8A) satisfy the following observability 
estimate: 
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"Ji * 
lzrlzz, «oum € C((B-DiDBi)zu,, Ver € L% (Q; H). (7.85) 


As far as we know, generally speaking, the observability estimate (C89) can- 
not be proved directly by the existing controllability /observability results for 
deterministic evolution equations, even if in the special case that Dı = 0. 


Remark 7.38. We have proved that the system (CZA) is null controllable if 
and only if it is exactly controllable, provided that A generates a Co-group 
and D is invertible. For deterministic systems, the condition that A generates 
a Co-group is enough to establish this equivalence. However, according to 
Proposition ÆJ, it is easy to see that, in the stochastic context the condition 
that D is invertible cannot be dropped. 


Next, we give the relationship for the approximate controllability of (ILZA) 
and (ZZ). 


Theorem 7.39. The system (CIA) is approximately controllable at time T if 
and only if the system (CA) is approximately controllable at time 0. 


Proof: We fix any € > 0, yo € H and yr € L3 (2; H). 

The “only if" part. Since (CZA) is approximately controllable, for any 
£1 > 0, one can find a pair of controls (u',v') € Ur x L2(0, T; U) such 
that the corresponding mild solution y!(-) € L2((25; C([0, T]; H)) to (C9) 
satisfies that y!(0) = yo and |y! (T) — yrlza,. (2;H) € €1. Denote by (y, Y) the 


corresponding solution to (L79) with the control u(-) replaced by u! (-). Then 


(9, Y) 2 (y, Y) — (yt, Dv!) solves the following backward stochastic evolution 
equation: 


dj(t) = (AG) + F(t)8(t) + DD Y (0))at 
-K(G(t)g(t) + Y (t)) aw (t) in [0, T), (7.86) 
$(T) = vr - v (T). 
By Theorem EE58, it follows that 
I8(0)lg < Cly’ (T) - Yr |, (2H) € Ce}. 


Let us choose £1 = a: Then, 


ly(0) — yol = ly(0) — y (nr = lg(0)lar < Cer =e. 


This implies that (C79) is approximately controllable. 


The “if? part. Since (CZ) is approximately controllable, for any £1 > 0, 
one can find a control u! € Ur such that the corresponding mild solution 
(y), Y! ()) e L2(9; C([0, T]; H)) x D2(0, T; £9) to (C) with the control 
u(-) replaced by u(-) satisfies y! (T) = yr and |y! (0) — yo| pg < £1. Denote by 
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y the corresponding solution to (ILZA) with the controls (u(-), v(-)) replaced 
by (u1(-), D-1Y 1 (-)). Then ĝ Êy — y! solves the following equation: 
eo = (Ag(t) + FEAE) dt + G(t)g(t)aW (t) in (0.T], 
9(0) = vo — y’ (0). 
By Theorem EIA, we have 


(7.87) 


A(T) z2 (ou S C|y (0) — yo|u < Cer. 
io 
Let us choose £1 = e 'Then, 
ly(T) — yrl (23H) = A(T) r2 (a) < Ce =E. 


Therefore, y is the solution to (L79) so that |y(T) — yr|rz. (o;r) < €. This 
T 
implies that (CZJ) is approximately controllable. L1 


7.5.2 The Case of Unbounded Control Operators 


In this subsection, O, O', F(-), f(-), B and G(-) are the same as that for 
the system (CH), and we assume that A generates a Co-group on both O 
and O’. Let U be the same control space as that in the Subsection LAJ, 
D € £(U; £5(V; O^)) be invertible, B1 € L(U; £2(V; O^)) and D, € L(U; 0’). 
We consider the following (forward) stochastic control system evolved on O’: 


dy(t) = (Ay(t) + F(t)y(t) + f(t) + Bu(t) + Dv(t))at 
+(G(t)y(t) + Dolt) + Biu(t))dw(t) — in(0,T], (7.88) 
y(0) = yo, 
and the following backward stochastic control system evolved on O’: 
dy(t) = (Ay(t) + F(t)y(t) + £(t) + Bu(t) + Dı1D tY (t))dt 
+(G(t)y(t) + Y (t) + Biu(t)) aW (t) in [0, T), (7.89) 
y(T) = yr. 


Here, y(-) is the state variable, u(-)(€ Ur) and v(-)(e L2(0, T; U)) are the 
control variables, yo(€ O") and yr(€ L7... (£2; O")) are respectively the initial 
and the final states. 

Note that in both ([.8M) and (E89) there is only one unbounded con- 
trol operator, i.e., B. For this unbounded control operator, we need similar 
assumptions as that in Conditions £I, and LA. More precisely, in this 
subsection we assume that 


e There exists a sequence {u,}°, C Ur such that Bu, € L2(0, T; O") for 
each n € N and (£10) holds; 
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e There exists a constant C > 0 such that for any € [0, T], £- € L} (2;0), 


nr € L2 (;O) and h € L2(0, T; £2(V; O)), the solution (£, E) to (C1) 
satisfies (LIN), and the solution 7 to the following equation 
dn(t) = —[A*n(t) + (F(t) - DD! G(t)) n(t) + G(t)*h(0)at 
+(—(D~!)*Din(t) + h(t)) dW (t) in (7, T], (7.90) 
mT) =M 
satisfies the inequality (22). 


Under these assumptions, similarly to Definition IL, a process y € Cr([0, T]; 
L?(Q; O')) is called a transposition solution to the system ([EN) if for any 
T € [0, T] and €, € L% (2; O), it holds that 














E(y (7). &) o, o m (yo, &(0)) 5, o 
=E f UOO dtte f (fi) Dis O oot (ran 






































+E l (Dolt) + Brult), E(£)) 6, von eatv oy do 


where (£, =) solves (IÆ). Also, similarly to Definition LIJ, a pair of processes 
(y, Y) € Cp((0, T; L2(2; O?)) x L2(0, T; C2(V; O^)) is called a transposition 
solution to the system (X9) if for every 7 € [0, T), ny € L% (2;O) and 
h € L2(0, T; £3(V; O)), it holds that 














Etur nT) oo — (UT) noo 


T 
= f (u(t), B*n(t)) ,, dt + 








Xj 




















T 
f (E(t) — PDP Bult), nO) o odt (7.92) 














T' 
+E | (V(t) + Brult), hE) evon cuc oyde 


where 7) solves (90). Proceeding exactly as that in Theorems and LTA, 
we can show that the systems (C88) and (C39) are well-posed in the sense of 
transposition solutions. 

Similarly to Theorem C31, we have the following result. 


Theorem 7.40. The system (CSJ) is exactly controllable at time T if and 
only if the system (C39) is exactly controllable at time 0. 


Proof: We only prove the “if? part (The “only if? part can be proved 
similarly). Let yo € O' and yr € L4 (Q; O") be arbitrarily given. Since (C89) 
is exactly controllable at time 0, one can find a control u € Ur such that 
the transposition solution (y, Y) € Cp([0, T]; L?(£2; O’)) x L2(0, T; L2(V; O")) 
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and by (92), for any 7’ € [0,7], nv € 


to (E89) satisfies that y(0) = 
T; L2 (V. O)), it holds that 


L (Q; O) and he L2(0 
E(yr.n(1))o, o = (y(r), 12’) oy o 


T T 
= gf (u(t), B*n(t)) dt + L (£(t) — DiD "Biu(t),n(t))o, odt (7.93) 




















R2 
































T 
+E f (YO+ Bult) A) avionet 
where 7 solves (£90) with 7 replaced by 7’. 

We claim that the same y as above is the transposition solution to (C89) 
with the above u and v = D- Y. Indeed, we only need to show that (ZU) 
holds for any 7 € [0, T] and & € L} (2; O), and the corresponding mild 
solution (€, €) to (£14). For this purpose, first by (C93) with 7’ € [0, T), 


&t)—n(t, E =- DnE +h), | ae.te(r,T), 


where (£, £) solves (C14) with 7 = T and êr € L},(9;O) given arbitrarily, 
we obtain that 


A P a T 


T q 
=x | (u(t), B*E(t)) ,dt + f, EO - Di Bilt). £)o, odt 


$ " 




















z] 
































1 


T 
+E / (Y() + Bit), 2) + (D PIE) vona — (1.94) 








ES 




















T T 
= f (u(t), B' &(t)) dt + Ji (E(t) + Div(t), E) or o dt 


1 7 














T 
+E / (Dot) + Bult), (0) avon voy 


$ 


Particularly, by (JÆ) and recalling that y(0) = yo, we have 


E(yr.£r) o; o = (vo: £(0))o, o 














T 


T' 
=E f (ul, BE) yd +B [ (£0) + DW. EO)o,04 — (ros; 














T 
+ a | (Dw(t) + Biult), E(£)) ,.. (v. 67) c voy dt 


Combining (CJA) and (£93), we get 
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E(y(r’), cP aie mi (yo; El) oo 














1 f 


=E f (ult), B*£(t)) dt + Ji (EE) + Div(t),£(0)5, odt — (7.96) 


























" 


$ e f (Dw(t) + Biu(t), E(t)) avon, evo 














Since ér € L3 (02; O) is given arbitrarily, by (ZG), we obtain (ZUM). 
Noting that y(0) = yo and y(T) = yr, we conclude the exact controllability 
of (C89) at time T. L1 


Similarly to Theorem L33, Corollary and Theorem L39, we can prove 
following result. 


Theorem 7.41. 1) The system (CRA) is null controllable at time T if and 
only if the system (CS9) is exactly controllable at time 0; 

2) The system (ZRH) is null controllable at time T if and only if it is 
exactly controllable at time T; 

3) The system (CX) is approximately controllable at time T if and only 
if the system (C79) is approximately controllable at time 0. 


Also, the exact controllability problem of (C89) can be reduced to a suit- 
able observability estimate for the following stochastic evolution equation on 


O: 
dr = —(A* + F* — G*(D+)*D3) dt — (D7)*DjzdW(t) in (0,7), 


(7.97) 
More precisely, similarly to Theorem C34, we have the following result: 


Theorem 7.42. The system (CXX) is exactly controllable at time T if and 
only if all solutions to (CJA) satisfy the following observability estimate: 











Ie»! 





T 
Izolo € € | |(B-—D1D~*B,)*x(t)|Zdt, V xo € O. 
0 
Remark 7.48. Clearly, similarly to Theorem L35, if Dı = 0, then, by Theorem 
CJJ, the exact controllability of (CSA) at time T is equivalent to that all 
solutions of the following random evolution equation on O: 


dx n " . 
ES = —(A* + F*)x in (0,1], 
x(0) = xo 


satisfy the observability estimate: 














T 
laoly <C J IB*x(t)2,dt, V zo €O. 
0 
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7.6 Notes and Comments 


Since the seminal paper [IG3], controllability and observability became the 
basis of Control Theory. Controllability and observability problems for deter- 
ministic systems attracted many studies. It is impossible for us to list them 
comprehensively even though we restrict ourselves to systems governed by 
abstract evolution systems. Interested readers are referred to |N, 67, B25] and 
the rich references therein. 

'The relationships between controllability and observability for determinis- 
tic linear control system are well-known, which can be established by several 
differential methods (e.g. (123, 2U2, 207]). Similar relationship in the stochastic 
setting has been studied in BO, 1125, (26, B03). 

'The main concern in this chapter is to reduce the controllability problems 
for both forward and backward stochastic evolution equations to the observ- 
ability or observability estimates of their dual equations, particularly for the 
case of unbounded control operators. To do this, as in [HU, 25, IZE, 202, B03), 
we use the classical duality argument. Note that, for concrete stochastic partial 
differential equations, it is far from easy to establish the desired observability 
or observability estimates. Actually, in the next four chapters, the main task 
is to derive the needed observability estimates for stochastic transport equa- 
tions, stochastic parabolic equations, stochastic wave equations and stochastic 
Schrödinger equations, respectively. 

In deterministic setting, the variational characterization on the forms of 
controls for the controllability problems provides a useful way to compute 
the desired controls numerically (e.g. [I23]). It would be quite interesting to 
extend these results to the stochastic setting. Nevertheless, as far as we know, 
there is no published result for the stochastic counterpart, especially on the 
numerical solutions to the stochastic controllability problems, even for that 
of stochastic evolution equations in finite dimensions. 

There are several other concepts of controllability for stochastic evolution 
equations (e.g. [5TI, Z5, B09, BIO, 876]). Among them, we mention the so-called 
e-controllability, which will be recalled below. For any & > 0, p € [0,1] and 
yo € H, put 


A 
S(e, p; yo) = (yr € H | P(|y(T) — yr|4; > £) < 1— p for some u € Ur}, 


where y(-) solves (ZG). Following [B09], we introduce the following notion of 
controllability: 


Definition 7.44. The system (CE) is called completely £-controllable in prob- 
ability p (in the normed square sense), if S(€,p; yo) = H for any yo € H. 


Rough speaking, if the system (LU) is completely ¢-controllable, then it can 
transfer any given initial state yo into the e-neighborhood of an arbitrary point 
in H with probability not less than p. This kind of controllability and some 
generalizations have been studied by several authors in the case that D = 0, 
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G = 0 and F is deterministic (in the system ([7.8)) (e.g., I, L, 253, 254, 255] ). 
In [I7], a stronger controllability concept was introduced for the system ([-G), 
that is, not only S(e,p;yo) = H for any yo € H, but also S(e,p; yo) = H for 
any yo € H, where 


A 
S(é,p; yo) = (yr € H | P(|y(T) — vrl; > £) < 1 — p and 


Ey(T) = yr for some u € Ur}, 














and y(-) solves (ZG). The above assumptions on D, F and G are essential for 
the method used in [I6, L7, 253), 254), 255], which reduces the ¢-controllability 
problem of a stochastic control system to the exact/approximate controlla- 
bility of a deterministic control system. To our best knowledge, there is no 
published works on the &-controllability problem for general stochastic control 
systems. 

Note that, unlike our definitions of controllability, when the stochastic con- 
trol system reduces to a deterministic one, the above complete ¢-controllability 
does not coincide with the usual notion of exact controllability. Because of this, 
it seems that our definitions are more physically meaningful. 

In Section E.3 of Chapter Hl, we have introduced the notion of transposition 
solution for backward stochastic evolution equations with general filtration, to 
overcome the difficulty that there is no Martingale Representation Theorem. 
In Section [LA, we also use the notion of transposition solution but the purpose 
is to overcome the difficulty introduced by the unbounded control operators. 
Note however that the idea to solve these two different problems is very similar, 
that is, to study the well-posedness of a “less-understood” equation by means 
of another “well-understood” one. To keep clarity, it seems that we would 
better use two different notions for them but we prefer keeping the present 
presentation because the readers should be able to detect the differences easily 
from the context. Note that, in this chapter, we assume that the filtration is 
natural. It would be interesting to consider the same problems (studied in 
this chapter) but in general filtration, for which people need to use the notion 
of transposition solutions to backward stochastic evolution equations (A), 
(79), (CA), (734), (C0, (CA) and (C89) (especially for (ZY) and (C89) 
with unbounded control operators) but this remains to be done. 

In many concrete control systems, it is very common that both the control 
and the observation operators are unbounded w.r.t. the state spaces. Typi- 
cal examples are systems governed by partial differential equations in which 
the actuators and the sensors act on lower-dimensional hypersurfaces or on 
the boundary of a spatial domain. The unboundedness of the control and the 
observation operators leads to substantial technical difficulties even for the 
formulation of the state spaces. In the deterministic setting, to overcome this 
sort of difficulties, people introduced the notions of the admissible control 
operator and the admissible observation operator (e.g. [298]). On the other 
hand, people introduced the notion of well-posed linear system (with possi- 
bly unbounded control and observation operators), which satisfies, roughly 
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speaking, that the map from the input space to the output one is bound- 
ed (e.g. ZIN, B05]). The well-posed linear systems form a very general class 
whose basic properties (such as that for feedback control, dynamic stabiliza- 
tion, tracking/disturbance rejection and so on) are rich enough to develop a 
parallel theory as that for control systems with bounded control and obser- 
vation operators. The concept of well-posed linear system was generalized to 
the stochastic setting in [Z32] but it seems that there are many things to be 
done to develop a satisfactory theory for stochastic well-posed linear systems. 


®) | 
u^ | 
Checkfor | 
updates 
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Exact Controllability for Stochastic Transport 
Equations 


In this chapter, we are concerned with the exact boundary controllability for 
stochastic transport equations. By the duality argument, the controllability 
problem is reduced to a suitable observability estimate for backward stochastic 
transport equations, and we employ a stochastic version of global Carleman 
estimate to derive such an estimate. 


8.1 Formulation of the Problem and the Main Result 


In this chapter and the next three ones, we shall apply our general controlla- 
bility results (for stochastic evolution equations) presented in the last chapter 
to some typical and concrete stochastic partial differential equations. As we 
shall see later, this is by no means an easy task. Indeed, general speaking, 
it is usually highly nontrivial to establish the needed observability estimates 
for the dual equations. In some sense, the transport equation is one of the 
simplest partial differential equations, and therefore in this chapter we shall 
focus on the exact controllability for stochastic transport equations. 

Let T > 0 and (2,7,F,P) be a complete filtered probability space on 
which a one dimensional Brownian motion W (-) is defined and F = {F;}+¢(0,7) 
is the natural filtration generated by W(-). Denote by F the progressive o-field 
(in [0,7] x 2) w.r.t. F. 

Let G C R” (n € N) be a bounded domain with a C! boundary I’. Put 


Q=(0,T)xG, Xzs(0T)xI, R= max [z[g. 
Fix any O € R” satisfying |O|pn = 1. Set 

r-S(zer|O-ws)«0), r*érwr-, 

X- 2(0,T) x T7, x*É(0,T) x rt. 
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Define a Hilbert space L2(I^) as the completion of all h € C (I^) w.r.t. 
the following norm 


1 
A 2 2 
igre S (- f, 0n ar) 


Clearly, the usual L?(I^) is dense in L2 (T7). 
Let us recall first the controllability problem for the following deterministic 
transport equation: 


y: +O -Vy = ay in Q, 
y=u on X7, (8.1) 
y(0) = yo in G, 


where a? € L?*(0,T; L®(G)). In (EI), y is the state variable and u is the 
control variable. The state and control spaces are chosen to be L?(G) and 
L?(0, T; L2(I—)), respectively. It is easy to show that, for any yo € L?(G) 
and u € L?(0, T; L2,(I.)), (E) admits one and one (transposition) solution 
yC) € C([0, T]; Z^ (G)). 

The system (E.I) is said to be exactly controllable at time T if for any 
given yo, yı € L?(G), one can find a control u € L?(0, T; L2,(I)) such that 
the corresponding solution y(-) € C([0, T]; L?(G)) to (E-I]) satisfies y(T) = yi. 

In order to solve the above exact controllability of (E.T), people introduce 
the following dual equation: 


z +0-Vz=-—ałz inQ, 
z=0 on X*, (8.2) 
z(T)= zr in G. 


By means of the classical duality argument (similarly to the conclusion 1) 
in Theorems CI and CZA), it is easy to show the following result. 


Proposition 8.1. The equation (T) is exactly controllable at time T if and 
only if solutions to the equation (R-2) satisfy the following observability esti- 
mate: 

lzr|12(@) S C|z|zz (z-); Y zT € I?(G). (8.3) 


Controllability and observability problems for deterministic transposition 
equations are now well-understood. Indeed, one can use the global Carleman 
estimate to prove the observability inequality (E-3) for T > 2R (c.f. [IG8]), and 
by which the exact controllability of (E-T) follows. In the rest of this chapter, 
we shall see that things are different in the stochastic setting. 

Now, we consider the following controlled stochastic transport equation: 


8.1 Formulation of the Problem and the Main Result 265 


dy + O - Vydt = (ary + asv)dt + (azy + v)daW (t) in Q, 
y=u on X^, (8.4) 
y(0) = yo in G. 
Here yo € L?(G), and aj, a2,a3 € LẸ (0, T; L~(G)). In (EI), y is the state, 
while u € L2(0, T; L2 (I^ )) and v € L2(0, T; L?(G)) are two controls. 


Remark 8.2. We introduce two controls into the system (E-4). Moreover, the 
control v acts on the whole domain, and also it affects the system through 
its drift term (in the form aav). Compared with the deterministic transport 
equations, it seems that we choose too many controls. However, by Proposi- 
tion [ZG, it is easy to see that two controls are really necessary for our exact 
controllability problem for (4) to be defined below. 


Solutions to (ŒJ) are also understood in the transposition sense. For this, 
we introduce the following backward stochastic transport equation: 


dz +O - Vzdt = — |(a1 + a2a3)z + a2Z|dt + (Z — a3z)dW(t) in Q7, 
z=0 on XF, 
zT) = 2: in G, 
(8.5) 
where 7 € (0, T], Q; = (0,7) x G, X$ = (0,7) x TH, z. € L3 (Q; L?(G)). 
Define an unbounded operator A on L? (G) as follows: 
| D(A) = {h € H'(G) | hlr- 20], 


(8.6) 
Ah=—O-Vh, Whe D(A). 


Clearly, D(A) is dense in H and A is closed. Furthermore, for every h € D(A), 
(Ah, h) r2(a) = -f hO - Vhdz = -f O «wh ar <0. 
G PF 


One can easily check that the adjoint operator of A is 
D(A*) = {h € H'(G)| h = 0 on TĦ}, 
P =O-Vh, YheD(A*). 
For every h € D(A*), it holds that 


(A*h, h) 12(@) =) hO - Vhdz = O - v|h|?d r7 < 0. 
G r= 
Hence, both A and A* are dissipative operators. By the standard operator 
semigroup theory (e.g., B4, Page 84]), A generates a contractive Co-semigroup 
on L?(G). 
By Theorem EL IU, we have the following well-posedness result for the back- 
ward stochastic partial differential equation (84). 
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Proposition 8.3. For any 7 € (0, T] and z, € LẸ} (Q; L^(G)), the equa- 
tion (BA) admits a unique mild solution (z, Z) € Lz(0; C([0, 7]; L?(G))) x 
L2(0,7; L?(G)) such that 


lzIr2co:cqo.niz209)) + lZlrzto.siz2(e) SCl (2126) (8.8) 


where C is a constant, independent of T and z,. 


Note that, by Proposition E-3, the first component z (of solution to 
(E-3)) belongs to L2(0; C([0, 7]; L?(G))), hence, it is not obvious that z|r- € 
L2(0,7; L5(1'-)). The latter is guaranteed by Proposition BG in the next 
section. This fact will be used in the next notion: 


Definition 8.4. A stochastic process y € Cg([0, T]; L?(Q; L?(G))) is called a 
transposition solution to (8A) if for any T € (0, T] and z; € LZ (0; L^(G)), 
it holds that 














E(y(T), Zr) n2(a) — (Yo, z(0)) r2() 


7 (8.9) 
= J (v, Z) r2 (a) dt — 
0 








zJ 




















f O-vuzdl' dt. 
o Jr- 


Here (z, Z) solves (84). 


The main result in this chapter is the following result for the exact con- 
trollability of (EJ). 


Theorem 8.5. If T > 2R, then the system (84) is exactly controllable at 
time T, i.e., for any yo € L?(G) and yr € L*. (9; L*(G)), one can find a 
couple of controls (u,v) € L2(0, T; L5(1-)) x L2(0, T; L?(G)) such that the 
corresponding (transposition) solution y to (ED) satisfies that y(T) = yr in 
G, a.s. 


Similarly to the conclusion 1) in Theorem (in Section [Z3), in order 
to prove Theorem K3, it suffices to establish a suitable observability estimate 
for (E53) with 7 = T. The latter will be done in Theorem (in Section B33), 
by means of a stochastic version of global Carleman estimate. 


8.2 Hidden Regularity and a Weighted Identity 


This section is addressed to present some preliminary results. We first prove 
the following result: 


Proposition 8.6. Solutions to the equation (XH) satisfy that 











lzlZ20,722 (r-) EC E|z-|72 (c); VTE (0, T], Ze E L*- (Q; L*(G)). 


Oo 
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Proof: For simplicity, we only consider the case of 7 = T. By Theorem E. TU 
and Proposition 7, one can show that if zp € L7... (£2; D(A*)), then the so- 
lution (z, Z) € (L3(Q; C([0, T]; L? (G))) n L2(0, T; D(A*))) x L2(0, T; L?(G)). 
It follows from Itó's formula that 














E|zrl22(ay — |2(0)lz2(oy 


T 
—-—2 J f zO - Vzdadt 
0 G 


T 
+ J l { — 2z[(a1 + a2a3)z + a2Z] + |Z — a3z|?}dadt. 
o JG 


























Therefore, 














T 
-e f O - vzdr dt 
0 Jr- 






































T 
< E|zrl72(c) +2 Ji L z|(a + d303)z + aaZ] dxdt < C E|z7|72 (a): 
(8.10) 
For any zr € L*. (2; L'(G)), we can find a sequence (Gy, C L*.(f2 
D(A*)) such that lim. oo 2) = zr in LF. (Q; L?(G)). Hence, the inequality 
(S10) also holds for zr € L7. (2; L?(G)). o 


Remark 8.7. The fact that z|r- € L2(0, r; L2 (T7)) (as shown in Proposition 
BG) is sometimes called a hidden regularity property, because it does not 
follow from the classical trace theorem of Sobolev spaces. 


We have the following well-posedness result for (E-4l) . 


Proposition 8.8. For any yo € L?(G), u € L2(0,T; L5(1)) and v € 
L2(0,T; L?(G)), the equation (SJ) admits a unique (transposition) solution 
y € Cp((0, T]; L?(2; L?(G))) such that 


luc; 0,T];L2(;L2(G 
w([0.7]:L?( (G))) (8.11) 


< C (|yolz2(a) kd |u|r2(o,T; L2, 7-)) a Iv r2 (or; z2())- 


Proof: Proposition is actually a consequence of Theorem (for 
abstract stochastic evolution equations). Here, for the reader's convenience, 
we give a "concrete" proof (without using the abstract result in Theorem 
LIZ). We only prove the existence. Since u € L2(0, T; L2,(I)), there exists 
a sequence (u,,) 4, C Cg([0, T]; Hi^ (r-)) with u4,(0) = 0 for all m € N 
such that 

lim um —u inL2(0,T;LA2(I-)) (8.12) 
m-—»oo 
For each m € N, we can find a à,, € C2([0, T]; H?(G)) such that à,,|r- = um 
and ŭm(0) = 0. 
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Consider the following stochastic transport equation: 
dij; + O : Vidt 
= (419m + aav + Gm)dt + [a2 (Uy + tm) + v]dW (t) in Q, Bas 
Ym — 0 on X, 
Ym(0) = Yo in G, 


where m = —tim,t — O- Viimdt + aitim. By Theorem ELTÀ3, the system (ECT) 
admits a unique mild solution ĝm € Ce([0, T]; L2(Q; L?(G))). 

Let jm = fm + tim. For any 7 € (0, T] and z, € L% (0; L?(G)), by Itó's 
formula and using integration by parts, we have that 











E(ym(T); zr} r2(a) — (yo, z(0)) z2 (o) 


E af (v, Z) r:(a)dt — J O-vugzdI" dt, 
0 o. Jr- 





(8.14) 


























where (z, Z) is the mild solution to (A). Consequently, for any m1, m» € N, 
it holds that 


























E(Um, (T) — Yma (T); zz) L(G) = — af O-v(Um, — Um, )\zdI dt. (8.15) 
0 Jr- 


Let us choose z, € L}, (9; L'(G)) such that |.|;z (o;r2(c)) = 1 and 














7 1 
E(Um, (T) — Uma (T); Zr) L2(G) = z tms (T) — Yma (T)lzz. (a:02(@)): (8.16) 


It follows from (E-T3), (E-TW) and Proposition KG that 














" 
lim.) — ima (laa, cozy < 2E f f _ O- ss = tma)zd rds 
ü 0 Jr- 
< C|um, — um; Ir2(o,T 22, 7-)) 2nd rgo, 22, (77) 
< C|um, — wm |r2(o,T;2, (77) 
where the constant C is independent of 7. Consequently, it holds that 
[Ya — YmalCe([0,7];L2(2;L2(G))) € Clumi — uma] rz(o,riz2 i77) 


Hence, {Ym €. is a Cauchy sequence in Ce([0, T]; L? (2; L?(G))). Denote by 
y the limit of {ym}; in Ce([0, T]; L?((2; L?(G))). Letting m — oo in (EIA), 
we see that y satisfies (RY). Thus, y is a transposition solution to (EA). 

Let us choose z, € L*- (f2; L'(G)) such that lz-|r2. (2:02(G)) = | and 














| 1 
E(y(T), 2-) :(a) = 3 lu (T)lza. (0120): (8.17) 
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Combining (E.J), (E-T7) and using Proposition E.G again, we obtain that 
Iu(T)lzz. (2;12(@)) 


< 2 (Ivo. 2(0)) z2¢e)| + | E [Araceae + | E I] O. vuzdT- dtl) 
0 o Jr- 


























< C (|volz2(a) i |u| 22(0,7;12,(P-)) + lvlz2(0,7;12(@)))» 


where the constant C is independent of 7. Therefore, we obtain the desired 
estimate (E.II). This completes the proof of Proposition RO. oO 


Next, we present a weighted identity for the stochastic transport operator 
d+ O - Vdt, which will play an important role in establishing the global 
Carleman estimate for (E-3]). 

Let A > 0, and let c € (0, 1) be such that cT > 2R. Put 


t Allies -«t- 5) | and 0 = e. (8.18) 


Similarly to (C44) (at least in spirit), we have the following key weighted 
identity: 


Proposition 8.9. Let u be an H'(R")-valued Itó process, and v = ĝu. Then, 
—6(£, + O - V£)v(du + O - Vudt) 
= -5d[(t +0-V2)v7| =50 :V[(&-0 - V£)v?] d+ [4 +0- V(O- V£) 


+20 - V&]v?at + aC +0-V0)(dv)? + (L +O-V0)*v7adt. 


(8.19) 
Proof: Clearly, 
0(du + O- Vudt) = 0d(0~'v) + 00 - V(0-*v)dt 
= dv + O- Vvdt — (& +0O-V2)vdt. 
Thus, 
—0(£ +O- Vi)v(du +O - Vudt) 
= —(& -- O- VO)v [dv + O- Vvdt — (h + O - Ve) vdt] (8.20) 








= — (& +0- Vv (dv + O - Vvdt) + (L + O - V£) v?dt. 


It is easy to see that 
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1 2 1 2 1 2 

—tivdv = —3d(hv ) + zy dt + g^ (dv) ; 
1 1 1 
—O- Vivdv = -340 - Vev?) + z0 V£,v?dt + n V((dv)?, 
1 1 
—4vO - Vvdt — —0- V (£v?)dt + 29s V4, v? dt, 
1 1 

-0: VvO : Vvdt = —50- V(O - Vtv?)dt 4- 50° V(O: V£)v?dt. 


This, together with (E-ZU), implies (R19). This completes the proof of Propo- 
sition KY. oO 


Remark 8.10. It is easy to see that, the spirit for proving the identity (E.IU) 
in Proposition BY is very close to that for the identity (C48). 


8.3 Observability Estimate for Backward Stochastic 
Transport Equations 


In this subsection, we shall show the following observability estimate for the 
equation (E5). 
Theorem 8.11. Jf T > 2R, then solutions to the equation (RA) with r = T 
satisfy that 

lr lr. (12 (8) = C(|z|2(o;r.z2, c7) + IZ|120,7:12(@))) 


(8.21) 
Y zr € LE, (2; 17(Q)). 


Proof: Applying Proposition to the equation (BM) with u = z, in- 
tegrating (R19) on Q, using integration by parts, noting (XIX) and taking 
expectation, we get that 


-æ | 0? (£, + O - V£)z(dz + O- Vzdt)dz 
Q 


























= XE f (cr -20-2)6 (T)z (Tz + XB | (cr +20: 2)6 (0)2" (0)dz 


























+A J O-v[c(T — 2t) - 20 - x]? Z2 dX... + 2(1 — c)A ef 0? z dxdt 
Q 





























+ J 0? (£ + O - Vt) (dz)? dz +2 J 0? (L + O - V0? z?dzdt. 
Q Q 


(8.22) 
By virtue of that (z, Z) solves (RB) with 7 = T, we see that 
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-2 J 0? (6 + O - V)z(dz + O - Vzdt)dx 
Q 





= 2E 








^ (& +0- Vl)z|(a + a2a3)z + a2Z] dxdt (8.23) 





























5 o 


< se 0 (4 +0-VoPAdrat «CE | 0° (z? + Z?)dzdt 
Q 


and 














» 
t 














(6 + O- V0)(dz)2de = J (6 + O- V£JZ — aszBdzdt 
Q 


























Nin oS 


< -E ij 0*(£&, + O - V0? z2dzdt + CE D 0? 2° dxdt (8.24) 
Q Q 














+4 af ?|£ + O - Vel|Z72 deat, 
Q 


By (&.22)—(8.24) and z(T) = zr in G, it follows that 





> 











J (cT — 20 - z)8?(T)z2.d« + Af (cT -- 20 - x0? (0) 2 (0)da: 
G G 


























+2(1 — c) f 0? z?dzdt + af 0? (0; + O - Ve)?z*dadt 
Q Q 


























<C f 0* (2? + X° Z? )dzdt — X J O-v|c(T — 2t) - 20 - x] 02°45, 
Q = 


(8.25) 
where the constant C > 0 is independent of A. 
Finally, recalling that R = max |x|g» and c € (0,1) are so that cT > 2R, 


by choosing A to be large enough in (RZJ), we obtain the desired estimate 
(821). This completes the proof of Theorem ET. o 


8.4 Notes and Comments 


The main result in this chapter is a modification and generalization of that 
in [Z1]. 

Generally speaking, there are three methods to establish the exact con- 
trollability of deterministic transport equations. The first one is to utilize the 
explicit formula of their solutions. By this method, for some simple transport 
equations, one can explicitly give a control steering the system from a given 
initial state to another given final state, provided that the time is large enough. 
It seems that this method cannot be used to solve our stochastic problem s- 
ince generally we do not have the explicit formula for solutions to the system 
(E-4). The second one is the extension method. This method was introduced 
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in [294] to prove the exact controllability of the classical wave equation. It is 
also effective to solve the exact controllability problem for many hyperbolic- 
type equations including the transport equations. However, it seems that it is 
only valid for time reversible systems, and therefore, it is not suitable for the 
stochastic problems in the framework of Itó's integral. The third method is 
based on the duality between controllability and observability, via which the 
exact controllability problem is reduced to suitable observability estimate for 
the dual equation, and the desired observability estimate is obtained by some 
global Carleman estimate (e.g., E3, IIG6G]). 

In the literature, in order to obtain the observability estimate, people 
usually combine the Carleman estimate and the usual energy estimate (e.g., 
(166, B84]). It deserves mentioning that the desired observability inequality 
(&-21) in this chapter is established directly by means of the global Carleman 
estimate (without using the energy estimate). Indeed, even for the observabil- 
ity estimate for deterministic transport equations, such a method provides a 
new proof which is simpler than that in [I6]. 

As mentioned in Remark EZ, in order to study the exact controllability of 
the system (E-4), people do need to introduce two controls u and v (and the 
control v acting on the whole domain in particular). Nevertheless, it seems 
unnecessary to introduce the extra control v if we are only concerned with 
null/approximate controllability of stochastic transport equations. It would 
be quite interesting to study such weak versions of controllability for (EA) 
(with the control v — 0) but it seems that some new tool should be developed 
to obtain nontrivial results. 

As far as we know, controllability problems for nonlinear stochastic trans- 
port equations are completely open. 


f 


Check for 
updates 





9 





Controllability and Observability of Stochastic 
Parabolic Systems 


This chapter is devoted to studying the null/approximate controllability and 
observability of stochastic parabolic systems. The main results can be de- 
scribed as follows: 


e When the coefficients of the underlying system are space-independent, 
based on the spectral method, we show the null/approximate controllabil- 
ity using only one control applied to the drift term; 

e For a class of coupled stochastic parabolic system with only one control 
(applied to also only one equation), the null controllability is derived when 
the system is effectively coupled by the drift terms and un-coupled by the 
diffusion terms; 

e By means of the global Carleman estimate, we establish the observability 
estimate for stochastic parabolic systems with considerably general coeffi- 
cients; 

e The null/approximate controllability of general stochastic parabolic sys- 
tems with two controls are shown by means of duality argument. 


In each of the above cases, we shall explain the main differences between the 
deterministic problem and its stochastic counterpart. 

In this chapter, T > 0 is given, and (Q, F, F, P) (with F 2 Fiet) isa 
fixed filtered probability space, on which a one dimensional standard Brownian 
motion W(-) is defined, and F is the corresponding natural filtration. We 
denote by F the progressive o-field w.r.t. F. 


9.1 Formulation of the Problems 


Parabolic equations (and its special case, i.e., the heat equations) are one class 
of most typical partial differential equations. In the deterministic setting, the 
controllability theory for parabolic equations are studied most thoroughly. It 
is then very natural to see what will happen for its stochastic counterpart. 
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Throughout this chapter, G C R” (n € N) is a given bounded domain with 
a C% boundary I’, and Go is a given nonempty open subset of G. Denote by 
XG, the characteristic function of Go. Put 


Q(0,T)x G, PaO Ter Qoĉ(0,T) x Go. 
Also, we assume that a/^ : G — R (j,k = 1,2,--- ,n) satisfies aJ* € C? (G), 
aĵ! = a*J, and for some so > 0, 


at (z)&;£; > so|£p^, V (x, £) = (oi, UT or 1: oF E €GxR"^. 
jk-1 
(9.1) 
We shall denote by C a generic positive constant depending only on G, Go, 
T and (a/*),,,, (unless other stated), which may change from one place to 
another. 
We begin with the following controlled deterministic parabolic equation: 


nm 
yi — XO ("ys en — ad: Vy a$y- xa,u in Q, 
jk=1 (9.2) 
y=0 on X, 
y(0) = yo in G, 


where a? € L?* (0, T; W ^99 (G; R")) and a9 € L® (0, T; L** (G)). In (EZ), y and 
u are the state variable and control variable, the state space and control space 
are chosen to be L?(G) and L?(Qo), respectively. The equation (E72) is said 
to be null controllable (resp. approximately controllable) if for any given yo € 
L?(G) (resp. for any given £ > 0, yo, yı € L?(G)), one can find a control u € 
L? (Qo) such that the solution y(-) € C([0, T]; L?(G))nL? (0, T; Hg (G)) to (E22) 
satisfies y(T) = 0 (resp. |y(T) —wilz2(a) € £). Note that, due to the smoothing 
effect of solutions to the parabolic equation, the exact controllability for (2) 
is impossible, i.e., the above £ cannot be zero. The dual equation of (J) reads 
as follows 


zt + 5 (aff zs Jen =—V - (afz) +a9z inQ, 
jk-l 

z=0 on X, 

z(T) — zo in G. 


(9.3) 


Write w(t, x) = z(T — t, x) and wo = zo. By (ŒA), it is easy to check that 
TL 


WU, — 5 (a/^w,,),, = —V-(aQw)- aw inQ, 
jk—1 
i (9.4) 
w=0 on X, 


w(0) = wo in G. 
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By means of the standard duality argument (similar to Theorem LIA), it 
is easy to show the following result. 


Proposition 9.1. i) The equation (ZY) is null controllable if and only if so- 
lutions to the equation (9.4) satisfy the following observability estimate: 


|w(T)|z2(@) <Clwlr2(Qo), ^ — V wo € L*(G); (9.5) 


ii) The equation (TA) is approximately controllable if and only if any solu- 
tion to the equation (9.4) satisfy the following unique continuation property: 


w=0 in Qo = wo = 0. 


Controllability and observability of deterministic parabolic equations are 
now well-understood. Indeed, one can use the global Carleman estimate to 
prove the observability inequality (E53) (c.f. I, B57]), and by which the 
null controllability of (EZ) follows. On the other hand, by Proposition I 
and the backward uniqueness for solutions to the equation (Œ), it is easy to 
deduce the approximate controllability of (8-2) from the null controllability of 
the same equation. In the rest of this chapter, we shall see a quite different 
picture in the stochastic setting. 

We now fix m € N and consider the following controlled stochastic parabol- 
ic system: 

TL 
dy — 5 (a? Ye, Jay lt 


j,k=1 


= b» aijjz; + a29 + Xa u + aav) dt + (azy -- v) AdW(t) in Q, (9.6) 


j=l 
y=0 on X, 
y(0) = yo in G, 
where 


(9.7) 
ay € Lg (0, T; L^(G;R?*)), k= 2,3,4. 

In the system (EL8), the initial state yo € L} (2; L'(G; R")), y is the state 

variable, and the control variable consists of the pair (u,v) € L2(0, T; L? (Go; 

R™)) x L2(0, T; L?(G; R")). The main goals in this chapter are to study the 

null and approximate controllability of (ELG). 


bs € Lg? (0, T; Wee R™X™)), j—12,--,n, 


Remark 9.2. Similar to the control system (EA), the term a4" reflects the effect 
of the control v in the diffusion term to the drift term. One can also consider 
the case that the control u in the drift term may influence the diffusion term. 
Nevertheless, since the control v in the diffusion term is acted on the whole 
domain, one can cancelation such effect by suitable choice of v. 
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From the proof of Theorem and using Theorem BIQ, it is easy to 
show the following well-posedness result for the equation (E.G). 


Proposition 9.3. For any yo € L7. (2; L'(G; R")) and (u,v) € L$(0,T; 
L?(Go; R")) x L2(0, T; L(G; R")), the system (GG) admits a unique weak 
solution y € L2(; C([0, T]; L(G; R"))) n L2(0, T; H(G; R")). Moreover, 


Iu|r2to;c(fo, T]; L2 (G;R))nz2(,T; Hà (G;R")) 
Sp (Ivolza. (o2 (Gam) + |(u, V)|12(0,7;L2(Go:R™)) x L2(0,T;L2 (GR )))» 
(9.8) 
where 
ri = M aislng oom (Giumm) + lal n= (o; L» (GR) 
j=l 


2 
+|a3| 72 (o, Le (Gem m: 


Note that we introduce two controls u and v in (ELG). In view of the 
controllability result for the deterministic parabolic equation (EQ), it is more 
natural to use only one control and consider the following controlled stochastic 
parabolic system (which is a special case of (ZH) with v = 0): 


TL 


dy — 5 [a gi, )«, dt 


j,k=1 
= (X ayya; +a2y + xcou)}dt + asydW(t) in Q, (9.9) 
j=1 
y= 0 on A, 


It is easy to see that, the dual system of both (HG) and (E:U) are respec- 
tively the following backward stochastic parabolic systems: 


dz + 5 (aff zs; as dit 





j,k=1 
-[*« (a1jz) aJ —ad a] )z — ad Z|dt--(-a1 z + Z)dW(t) inq, 
j=l 
z=0 on X, 
z(T) = 27 in G. 


(9.10) 
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dz+ 5 (aff z, .)., dt 


jk-l 
= IX: (a1;2),,. - aĵ z — aj Z| dt + ZAW (t) in Q, (9.11) 
j=1 
z=0 on X, 
z(T) = zr in G. 


Similar to the proof of Theorem and using Theorem ELI, one can 
show the following well-posedness result for the equations (@10) and (ETT): 
Proposition 9.4. Under the condition (8-2), for any zr € L*.. (2; L(G; 
R™)), the system (ZID) (resp. (S-T1I)) admits a unique weak solution (z, Z) € 
(Ce([0, T]; L? (2; L?(G;R™))) N Le(0, T; Ho (G;R™))) x L800, T; L?(G;R™)). 
Moreover, for any t € [0, T], 


IC), Z())l(esqo.q.z2(0:12(6:8))o (0,t:H4 (G:R™))) x L2 (0,5 L? (G;Rm)) 


" (9.12) 
< Ce"! |z(t)lrz. (2,22(G:R™)); 
where 
TL 
Kı = 5 a13| ge (oT; Wee (Gm m) + |a2| ne (oT; Lee (G;Rm m) 
j=l 
i (9.13) 
2 
+ 5 |a [Ts (oT Lo» (Gm xm) 
k-3 


(resp. 
n 


kı = $ larglage(o,rwie (imm) + laal eg (0,731 (ime) 
j=l 


2 
+|a3 [LE (0,T;L>(G;Rmxm)) j 


In order to obtain the null controllability of (E.J), by Theorem LIA, we 
need to show that solutions to the system (ELTII) satisfy the following observ- 
ability estimate: 


I2(0)| ra. (12 (Gm) < C|xao Z| r2(o,T; L2 (Go;R")): 


(9.14) 
V zr € L (R; L'(G; R”)). 


Unfortunately, at this moment, we are not able to prove the observability 
estimate (ELT4). Instead, we obtain a weak version of (@14), i.e., a weak ob- 
servability estimate (for the system (E.IU)) in Theorem E34 (See Section BA). 
By duality, Theorem E37 implies the null controllability of (E.G). 
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There exist two main difficulties to establish (E.I4). The first one is that, 
unlike the deterministic setting (See (EL3)-(E.4)), it is impossible to reduce 
the backward stochastic parabolic system (ELIU) to a (forward) stochastic 
parabolic system. The second one is that, though the corrected term “Z” plays 
a “coercive” role for the well-posedness of (S10), it seems to be a “bad” (non- 
homogeneous) term when one tries to prove (ZIA using the global Carleman 
estimate. 

At least at this moment, generally speaking, technically we do need to 
introduce the second control v in (E.G). Indeed, it is unclear whether it is 
possible or not to use only one (F-adapted) control u such that the following 
random parabolic system 


TL 


T 
y —. XO (al yo, Jax = Maus; Fa2xytxau ing, 
j,k=1 j=1 
i : (9.15) 
y=0 on X, 


y(0) = yo inG 


is null controllable. The answer seems to be “yes” but we do not know how 
to prove it for the general case. 

Of course, it is quite interesting to study the controllability of (9), in 
which only one control u is introduced. So far, this problem is much less 
understood. Indeed, positive results are available only for some special cases 
of (ZY) when the spectral method can be applied (See Sections H2HZ3). As 
we shall see later, even for these special cases, some new phenomenons will 
appear in the stochastic setting. 

Although it does not imply any controllability of the same sort equations, 
the observability of stochastic parabolic equations is still an interesting control 
problem. Because of this, as another main goal in this chapter, we shall study 
observability estimates for the following stochastic parabolic equation: 


TL 


dz- Y (aze), dt = (Shue, + boz)dt + b3zdW(t) in Q, 
= 


j,k=1 
z=0 on X, 


z(0) = zo in G, 
(9.16) 


bij € Lg (0,T; LG R™*™)), J = L2, Th 
| T cr (9.17) 


65,03 € LẸ (0, T; L (G; R™*™)). 
As a consequence of Proposition EA, it is easy to show that 


Corollary 9.5. For any zo € L?(G;R™), the system (ELT8) admits a unique 
weak solution z € L2(0; C((0, T]; L?(G;R™))) n L2(0, T; Hà (G; R")). More- 
over, for any t € [0, T], 
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Iz) Irz(o;c um] r2 (GR ))nz2 (T; (G;R")) < pee Iz (0) za. cos c2 ism) 
(9.18) 
where 


k2 = p» [bijl ree (0/7; L9 (GR )) + |b2| Le (o; T; (GR m) 
j=l 
+|bslZ20 (or 1 m 
We shall give an observability estimate for (ZIG) in Theorem (of 
Section ELE). Since we assume only that b3 € LẸ (0, T; L” (G; R™)) (in (ELT2)), 
one needs to overcome some difficulty to derive the observability estimate 
(93) for the system (LIG). 
When m = 1 and b3 € Lg? (0, T; W>%(G)), (L1G) can be reduced to a 
random parabolic equation. To see this, we write J = e^ Jo bs(s)dW(s). and 
introduce the following simple transformation: 


Z=Vz. (9.19) 


Then, one can check that Z satisfies 


Zt E 5 (à z,.).. = NT + bok in Q, 
j,k=1 j=1 
(9.20) 
Zz-—Ü0 on X, 
£(0) = zo in G, 


t 
h; = by - 2 a f boa dW(G), j=1,2 un, 
0 


b = by — 58 df b3 z; (5 Jas. (f baay (5)AW(5)) 
k= 


jk=L 


+ 3 ait f bsx, (s)dW ( Wi bs s, (S)dW (s). 


j,k=1 


One may expect that the observability estimate (@93) (in Theorem EZA) 
for (E.IG) follows from a similar observability estimate but for the random 
parabolic equation (@20). But usually this is not the case. Indeed, it is easy 
to see that, in general neither bj nor b» is guaranteed to be bounded (w.r.t. 
the sample point w) unless b3 is space-independent. Because of this, it seems 
that one cannot use Corollary (which is a global Carleman estimate 
for random parabolic equations) directly to derive any useful observability 
estimate for (ELZU]). 
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Remark 9.6. When m > 1, general speaking, one cannot use the above tech- 
nique (by introducing a suitable transformation like (ELTJ)) to reduce (E-Td) 
to a random parabolic system even if bz € LY (0, T; W>% (G; R*m)), 


9.2 Controllability of a Class of Stochastic Parabolic 
Systems 


This section is based on [225]. Throughout this section, we consider the fol- 
lowing stochastic parabolic system: 


TL 


dy — X` (a/^y,,)., dt = [a(t)y  xg(t)xas (x)u]dt + b(f)ydW(t) in Q, 
jk-l 


y-0 on X, 


y(0) = yo in G, 
(9.21) 

where a(-) € Lg? (0, T; R"*"") and b(-) € LE (0, T;R™X™) are given, E is a 
fixed Lebesgue measurable subset in (0, T) with a positive Lebesgue measure 
(i.e, m(E) > 0). In (E-ZI), y is the state variable (valued in L?(G;R™)), 
yo € L?(G;R?) is the initial state, u is the control variable, and the control 
space is Lg? (0, T; L?(Q; L?(G;R™))). 

We have the following null controllability result for the system (B.ZT]). 


Theorem 9.7. The system (ZZ) is null controllable at time T. 
We shall give a proof of Theorem KA in Subsection EZZ. 


Remark 9.8. As we mentioned in Section EI that, when E = (0, T), one can 
use the global Carleman estimate to prove the corresponding null controlla- 
bility result for the deterministic counterpart of (E-ZT). However, at least at 
this moment we do not know how to use a similar method to prove Theorem 
EZ even for the same case that E = (0, T). 


Next, we consider the approximate controllability for the system (ELZTI) 
under a stronger assumption on the controller E x Go than that for the null 
controllability. 


Theorem 9.9. System (TZI) is approximately controllable at time T if and 
only if m((s, T) N E) > 0 for any s € [0, T). 


We refer to Subsection for a proof of Theorem BY. 

At the first glance, it seems that Theorem EY is unreasonable. If b(-) = 0, 
then the system (ELZT]) is like a deterministic parabolic equation with a ran- 
dom parameter. The readers may guess that one can obtain the approximate 
controllability by only assuming that m(E) > 0. However, this is NOT the 
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case. The reason for this comes from our definition of the approximate con- 
trollability for the system (E-ZI). We expect that any element belonging to 
L*. (9; L'(G)) rather than L5 (0; L?(G)) (s < T) can be attached as close 
as one wants. Hence we need put the control u to be active until the time T. 

In some sense, it is surprising that one needs a little more assumption in 
Theorem EY for the approximate controllability of (ZI) than that in Theo- 
rem EZ for the null controllability. Indeed, it is well-known that in the deter- 
ministic setting, the null controllability is usually stronger than the approxi- 
mate controllability. But this does NOT remain to be true in the stochastic 
case. Actually, from Theorem EY, we see that the additional condition (com- 
pared to the null controllability) that m((s, T)] E) > 0 for any s € [0, T) 
is not only sufficient but also necessary for the approximate controllability of 
(E-ZT). Therefore, in the setting of stochastic distributed parameter systems, 
the null controllability does NOT imply the approximate controllability. This 
indicates that there exists some essential difference between the controllabil- 
ity theory between the deterministic parabolic equations and its stochastic 
counterpart (See also Remark EX). 


9.2.1 Preliminaries 


In this subsection, we collect some preliminary results that will be used sub- 
sequently. 

To begin with, we recall the following known property about Lebesgue 
measurable sets. 


Lemma 9.10. (205, pp. 256-257]) For a.e. t € E, there exists a sequence of 
numbers (t;)294 C (0, T) such that 


ti «t «xl < tip ko <t, t;—tasi— oo, (9.22) 
m(En [ti, ti+1]) 2 pi (tiui m ti), i= 1, 2,- t3 (9.23) 
QE tdt des. desc ess (9.24) 
tise — tind 


where pı and p2 are two positive constants which are independent of i. 
Next, let us define an unbounded operator A on L?(G) as follows: 


D(A) = H*(G) n HAG), 


Ah=— M (aha) VA € D(A). (9.25) 
j,k=1 


Let (4; ;2, be the eigenvalues of A, and {e;}%2, be the corresponding eigen- 
functions satisfying |e;|rz(G) = 1, à = 1,2,3---. It holds that 0 < Àj < A2 < 
Ag € € Ay €: — oo. For any r > A1, write A, = {ieN | Ai <r}. We 
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recall the following observability estimate (for partial sums of the eigenfunc- 
tions of A), established in [Z30, Theorem 1.2] (See also [192, Theorem 3] for 
a special case of this result). 


Lemma 9.11. There exist two positive constants Cy > 1 and C3 > 1 such that 


5 la;|? < Cye2¥" 5 mei(a)| dz (9.26) 


i€ A Co jcA. 





holds for any r > A, and aj € C with i € Ap. 


Further, for any s, and s2 satisfying 0 < sı < sg < T, we introduce the 
following backward stochastic parabolic system: 


dz - V (a*z,,),, dt = —[a(t)"z + b(t)" Z]dt + ZAW (t) in (51,52) x G, 
j,k=1 
z=0 on (51,82) x I, 
z(s2) = in G, 
(9.27) 

where 7) € Lx (2; L?(G;R™)). 

Put 

ro = 2|a|rz»(o,r mx) + [blie (or Rom) 

For each r > 1, we set H, = span{e; | A; € r} and denote by II, the 
orthogonal projection from L?(G) to H,. Write 


mM times 


—————_ md 
H” = H, x H, x- x H,. (9.28) 


To simplify the notation, we also denote by HM, the orthogonal projec- 

tion from L? (G; R”) to H™. We need the following observability result for 

(227) with the final data belonging to Lt (2; Hi"), a proper subspace of 
2 .T2(6- Rm 

Ly (5L (G;R™)). 

Proposition 9.12. For each r > M, the solution to the system (9.27) with 

nE Lt (2; H7") satisfies that 


. 2 CeC2 Vr *ro(s2 51) 2 
: ECTS = (m(En [51, 82]))? [XEXGo? Li (s1,52;L? (Q; L? (G;Rm)))? 
(9.29) 

















whenever m(E n [s1, s2]) # 0. 


Proof: Each ņ € L}, (2; H7") can be written as r = 5 miei(x) for some 
i€ A, 
ni € Lx (Q2; R") with i € A,. The solution (z, Z) to (@27) can be expressed 
as 
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2= 5 zi(te;, Z= 5 Zi(t)ei, 


iC A, i€ A; 


where z;(-) € Ce([s1, s2]; L?(2; R")) and Z;(-) € L2(s1, s2; R"), and satisfy 
the following equation 


zi(T) = ni 
By Lemma LM, for any t € [s1, s2], we have 


E | Itl dz =E Ð |2i(t) Bm < cie TE [| 5^ awe 
G G 


i€ A, 0 i€A, S 30) 
= Quer J |z(t)|fm da. 
Go 















































By Itó's formula, we find that 


d(e ziem) = roe" |zlfem + e" ((dz, z gm + (2; dz) gm) +e% |dzliam. 


pi Iz (lies dz) — (e f |z(s1 is dz) 


JN! e'?*|z( 8) |fimdads +2 X JJ e"s Ail z;(s)|2.. ds 
sı 


iC A. 


Hence, 









































=r 


a 














(9.31) 








E e"? ( — la(s)" z(s s)! Z(s),z(s 
«f f (— (a(s)" 2(s) + bs)" Z(s), (8) gm 


—(2(s),a(s)"z(s) + b(s)' Z(s)) qm + |Z(s) liam) dards 


t 
= 2 5 J e"9* Az; ()|2,. ds > 0. 


icA, "$i 














From (EL3U) and (EL3I), we obtain that, for any t € [s1, s2], 


























Bf tma da < citt f, |2(t, a) [am de. (9.32) 
0 


By (E-32), it follows that 


1 
f Ef lz(s, alios da] * dt 
Ens: ,s2] G 
1 


« (CyeC2vitrolsa—s1)) 2 | Ef |2(t,2) fim da] * di 
En{s1,s82] Go 
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Hence, when m(E N [s1, 82]) #0, we obtain that for each 7 € Lx (Q; Ep 














E f PON S 
G 


Cea V rtro(sa-51) $2 ? I 2 
< E m 
7 (m(Eh [s1, s5])? { f | I Ix (t)xao (x) z(t, x) |i da] de} 


Cy eC2 vT +ro(s2—s1) : 
~ (m(En [si s3])2 IXEXGo? ls (s, sait? (0512 (GR): 























which gives (E-Z9). o 


By means of the usual duality argument, Proposition yields a partial 
controllability result for the following controlled system: 


dy — » (a^ y, s, dt 

jk-l 

= [a(t)y + xexc,uldt + b(t)ydW (t) ^ in (s1,529) x G, (9.33) 
y=0 on (s1, 82) x T, 
y(51) = Vs in G, 


where ys, € Le (2; L?(G;R™)). That is, we have the following result. 


Proposition 9.13. If m(E A [s1, s2]) Æ 0, then for every r > A1 and ys, € 
Le (Q2; L?(G;R™)), there exists a control up € LẸ (1, 82; L?(Q; L?(G; I«R"))) 
such that the solution y to the system (@33) with u = u, satisfies that 
IT,.(y(s2)) = 0, a.s. Moreover, u, verifies that 


5 CeC2 Vir ro(s2—51) " 
lur [7 (5, sa L2 (9; L2 (GR) S (m(E n | DE Ys: rem (2;L?(G;Rm))* (9.34) 





$1, 52 


Proof: Define a subspace H of L#(51, $2; L? (2; L?(G; R"))): 
H = {f = XEXGoŽ | (z, Z) solves (£27) for some n € LL (0; Hr) 


and a linear functional £ on H: 














L(A) =-E | sss) jus dr 
By Proposition UIA, it is easy to check that £ is a bounded linear functional 
on H and 


Cy eC2 V r*ro(s2-51) 
I£lz arg) € lusilz2.. (o r2 (Gm) 
(m(E n [s1, s3]))? Fs, (2L? (G; 
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By the Hahn-Banach Theorem, £ can be extended to a bounded linear func- 
tional £ (satisfying || etra css oat CO L2 CR) = |£|eurag)) on Lp(s1, s2; 
L?(Q; L?(G;R™))). By Theorem 2223, there exists a control up € LẸ (s1, $3; 
L?(Q; L?(G;R™))) such that 


























eff (ur, f gs didit =L(f), V f c Li(s1, 82; L? (2; L? (G; R™))). 
$1 G 


Particularly, for any n € Lx (2; Hi”), the corresponding solution (z, Z) to 
(27) satisfies 


























E J f (us, XEXGo2 Jem dadt = —E f (ge 2(s1))rmde. (9.35) 
Sı G G 


Applying Itó's formula to (y, z)g«, where y solves the system (E33) with 
u = ur, we obtain that 


E f Garde de =E | Gs 


























(9.36) 














G 
s2 
= J f (XEXGoUr, Z pm dxdt. 
S1 G 


Combining (235) and (30), we arrive at 














Ef (ulsa)smgmide = 0, Vn ELE, (0 HP), 
G 
which implies that I7,(y(s2)) = 0, a.s. Moreover, 


[ur rg» (s.s; L2 (0:12 (GR )) = [Ll earag) 
which yields (E34). L1 
Finally, for any s € [0, T), we consider the following equation: 


dy — X` (a/^y,,),, dt = a(t)ydt + b(t)ydW (t) in (s, T) x G, 
j,k=1 
(9.37) 
y=0 on (s, T) x T, 
y(s) = ys in G, 
where y, € L2 (2; L?(G;R™)). Let us show the following decay result for the 
system (E31). 


Proposition 9.14. Let r > A1. Then, for any ys € Le (Q; L?(G;R™)) with 
IT.(ys) = 0, a.s., the corresponding solution y to (9.31) satisfies that 














Ely(t)l erare) € e Cro 9 yeliz (orate) Vte[s, T]. (9.38) 
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Proof: Since y, € L} (2; L'(G; R")) satisfying M, (ys) = 0, we see that 
Ys = Jiena, ¥5ei for some y; € L} (Q;R™) with i € NV A,. Clearly, the 
solution y to (E37) can be expressed as y = ? /;ew 4, y'(t)ei, where y(-)€ 
Cr((s, T]; L2 (32; IR") solves the following stochastic differential equation: 


l dy! + Auy'dt = a(t)y'dt + b(t)y’dW(t) in [s, T], 
y (s) = ys 
By Itô’s formula, we have that 
d(eOr To 9) yia) = eC dy, y Jam + (y, dy Jam) 
err) dym + (ar — roe 6-9 yf. 


Hence, by A; > r for each i € N\ A, and recalling that ro = 2|a| rz» (oT Rm) + 
[Plc (o remm): we arrive at 


























E | eQr-r)-9 y. da — E I |y(s) liam d 
G G 
t 
--2 DO NE | cP de 


i€N\ A, 


t 
j J f elr=ro)lo—s) (tL ay, y Vem + (Y, ay )pm) dado 
s JG 
t 
dc J f eQr-roXe-3 b(o)u(o)|2., dado 
s JG 


t 
+(2r — ro) J errs) ly (gq) [2 dado 


S 















































<0 


, 


which gives the desired estimate (E38) immediately. Oo 


9.2.2 Proof of the Null Controllability 


This subsection is devoted to proving the null controllability result for the 
system (£21), i.e., Theorem EZ. For simplicity, we assume that m = 1. The 
proof for general m is similar. 

By Lemma ELTU, we may take a number t € E with £ < T and a sequence 
{tn}; C (0, T) such that (EL22)-(E-24) hold for some positive numbers pi 
and p. 

Write Jo = wv(ti), where v(-) solves the following stochastic parabolic 
system: 
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di — M 7 (a* We; )a,dt = a(t)idt + b(£)bdW(t) — in (0,t1) x G, 


j,k=1 
y -0 on (0,t1) x T, 
(0) = yo in G. 


Let us consider the following controlled stochastic parabolic system: 


TL 


dj— $ (a/*j..)., dt 

j,k=1 

= [a(t)j + xexe ü]dt + b(t)gdW(t) — in (t,t) x G, (9.39) 
g=0 on (t,t) x T; 
(ti) = do in G. 


It suffices to find a control à € Lg? (t1, t; L?(Q; L?(G))) with 














-42 215.12 
ll rs s zr) € CElsiol oq: Pap 


such that the solution j to (Œ39) satisfies (t) = 0 in G, as. 

Set In = [ton-1, tan] and Jy = [tow ton 41] for N € N. Then [t1,t) = 
Une UnUJn). Clearly, m(ENIy) > 0 and m(EN Jy) > 0. We will introduce 
a suitable control on each Iy and allow the system to evolve freely on every 
Jn. Also, we fix a suitable, strictly increasing sequence {rv }%?_, of positive 
integers (to be given later) satisfying that Ay < rı < ra < --- < ry — oo as 
N — oo. 

We consider first the controlled stochastic parabolic system on the interval 
Ii = |ti, t2] as follows: 


T, 


dyi = 5 (ayi s; dt 


j,k=1 
= ja(t)yı + XeExcouildt + b(t)yidW(t) — in (t1, te) x G, (9.41) 
yı =0 on (t1, t2) x T, 
yı (tı) = Yo in G. 


By Proposition ETÀ, there exists a control u1 € LẸ (t1, t2; L? (Q; L?(G))) with 
the estimate: 

à C,eC2 Viri troT "TP 

ule (ty to; L2 (0:12 (6))) < (m(E n lti, t2]))2 E|Yolz2(G): 

















such that IM, (y(t2)) = 0 in G, a.s. By (EZ3), we see that 


5 z C,eC2 Viri troT e" 
halte (ta tarem S Tar — yr Polaco: (9.42) 
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Applying Itó's formula to e-(ro*Dt|y, (lata): similar to the proof of (3I) 
and Theorem EZA, we obtain that 





e CotUta 





Eli (t2) l22 (6) 


t2 
gi (h)l22 (a — (ro +1) Ef aaa) ly |2deds 
ty G 


t2 
gj aa) al y, s; Y1, æ deds 
tı G 


t2 
+E | e= (rots | [2a(s)lyn|2 + [b(s)y1|?’]dzds 
G 














—(ro+1 tig 

















=e 















































t2 
ex | a) XEXGoUiyidxds 
G 


ti 




















t2 
St Ely: (t1)iZ2¢@) + af pied [u^ dx ds 
tı G 


e (ro+1)tı _ e (ro+1)t2 























= +1)tim!~ I2 2 
< € (ro ) 1] Ido |z2 (c) + TO ra 1 |ui [7 (4, ,t2:L2(2;L2(G))) 
Hence, in view of (E72), 
CaeCs v": 








m 

















|ui (t2)]72(5) € Tolza) (9.43) 








(t2 — t1)? 


where C3 = max(2p; ?C1 e?ro* UT, C3). 
Then, on the interval Jı = [t5,t3], we consider the following stochastic 
parabolic system without control: 


TL 


dz, — X (az, ),, dt = a(t)z dt + b(t)z dW(f) — in (ta, ts) x G, 
j,k=1 

Zz, =0 on (to, t3) x T, 

zı(t2) = yı (t2) in G. 


Since M, (y1(t2)) = 0, a.s., by Proposition ELT, we have 

















Ez (t3) 22(e) < eC ?71179 05 2E (ta) [72 
Cze rs e 2r trots =t) Elio] 2a. (9.44) 
= fy =r L*(G) 


Generally, on the interval Iy with N € NX {1}, we consider a controlled 
stochastic parabolic system as follows: 
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TL 


dyn — 5 (aj yw.) dt 





j,k=1 
= [a(t)yn + xeXcoun]dt + b(t)ywdW(t) in (tən-1,t2N) x G, 
yn =0 on (ten-1, ten) x T, 
yn (ton—-1) = 2n-1(tan-1) in G. 


Similar to the above argument (See the proof of (@42) and (@43)), one can 
find a control uy € Lg? (ten-1, ten; L? (Q; L?(G))) with the estimate: 









































3 C4 eC2 V TN *roT " 
luv Tros (tan 1 tan sh?(2;L2(@))) S play — tau a? E| zv 1 (tav -1)| ra (o: 
(9.45) 
such that IT... (yv (tay)) = 0 in G, a.s. Moreover, 
Caes VTN 
E t 2 < ——____E t 2 : 9.46 
lyn (t2v)lz2(o) S (oy GN? |zw-1(t2n-1)|Z2(@) (9.46) 


On the interval Jy, we consider the following stochastic parabolic system 
without control: 


n 


dzn — 5 (aj zw.) dt 


j,k=1 
= a(t)zwdt + b(t)zndW (t) in (ten, ton 41) x G, 
zn = 0 on (ten, t2N+1) X T, 


zn (tan) = yn (ten) in G. 


Since IT, (yv (ten )) = 0, a.s., by Proposition E-T4l and similar to (E-24), and 
recalling that yw(t2w—1) = zw-1(taN-1) in G, we have 











E|z (tow 41) l2 (e) 
CaeCo VTN 

~ (ten — tau 1)? 
Caeli TN 

2 


C (ten — tav-1) 








e C2rw tro) (tan +1—t2n) E, 














yn (tan-i)l t2) (9.47) 














e ?*N (tan+1—tan) 





zn—1(tan—1)|72(@)s 


where C4 = Cae"? 
Inductively, by (24) and (EX), we conclude that, for all N > 1, 
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E|zw (tav +1)|72(@) 
Ch elal ri tra eri) 


~ (ten — tan 1)" (taw-2 — tav-3)? +++ (t2 — t? 











xexp{ — 2ry (ten+1 — ten) — 2rnw—i(ten—1 — ton—2) 





(9.48) 











— — 2rı (t3 = ta) E|do[7.2 (c) 
CY exp (CAN Vw — 2rn (ton 41 — ton) 
~ (ta — ten—1)?(tan—2 — tan—3)? +++ (t2 — t1)? 


CN pN N-D exp {CaN, /rN — 2(t2 — t1) py ry) P 
S (t9 — t4)2N E [Bo [12 (a)- 





2 
Vo z2(a) 



































By (24), (E-253)-(E-48) and (T48), we see that 


2 
|v [zo to a tov L2 (0:22 (G))) 


ao 2N(N—1) 


pis m exp [ev + roT  C4(N — Y) /rN-1 (9.49) 
1 


—2(t; — t1)p3 ry i} E|dol7:2(c)- 

















and 











Elyn (ton )I22 (a) 


Co. 


(t — HN exp [es vr + CaN = Dyrx-a (9.50) 




















—2(ta —t)p3 ^" ry i} ElGolZ2(a)- 


We now choose ry = max(2N”, [A,] + 1). From (E-29)- (E-50]), it is easy to see 
that, whenever N is large enough, 






































2 l eris 
lun [Too (tow —1,tan3L?(@;L2(@))) € oni lYolz2(@) (9.51) 
and ; 
Elyn (tax )l2te) S 5 Eliiolz2te: (9.52) 


We now construct a control à by setting 
uw(t,z), (t,2)€InxG, N>1, 
ult, x) = 
0, (tz) € Jn xG, N21. 
By (E-51), we see that à € LY (t1, t; L?(2; L?(G))) satisfying (120). Let g be 
the solution to the system (E-39) corresponding to the control constructed in 
(EL5:3). Then 9(-) = yv (-) on Iw x G. By (E-52) and recalling that ty — t as 


N — oo, we deduce that g(t) = 0, a.s. This completes the proof of Theorem 
E L1 


(9.53) 
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9.2.3 Proof of the Approximate Controllability 


'This subsection is devoted to giving a proof of the approximate controllability 
result for the system (@21), i.e., Theorem DY. 

To begin with, we show the following two preliminary results, which have 
some independent interests. 


Proposition 9.15. If m((s, T)(]| E) > 0 for any s € [0, T), then for any 
given n € L*.. (2; L'(G; R")), the corresponding solution to (EZI) with s, = 0 
and s2 = T satisfies 


lz(s)lzz. (o;z2(GR)) S CG)IxgxaczIEpisriz2(oiz2 (GR): (9.54) 
Here and henceforth, C(s) > 0 is a generic constant depending on s. 


Proof: The proof of Proposition {14 is very similar to that of Theorem 
LII. We consider the following controlled stochastic parabolic system: 


TL 


dy — 5 (059. legal 


jk-l 

= [a(t)y + x(s,r)nBXGouldt + b(t)ydW(t) in (s,T) x G, (9.55) 
y-0 on (s, T) x I, 
y(s) = ys in G, 


where y is the state variable, u is the control variable, the initial state y, € 
L*. (2; L?(G;R™)) and the control u(-) € LẸ (s, T; L?(Q; L?(G;R™))). By 
the proof of Theorem E, it is easy to show that the system (EL55) is null 
controllable, i.e., for any ys € LZ (Q; L?(G;R™)), there exists a control u € 
Ls? (s, T; L?(2; L?(G;R™))) such that y(T) = 0 in G, a.s., and 

lues (sir L2 C0 L2 (GR) < C(s)lusla. (2;12(arm)) (9.56) 


Applying Itó's formula to (y,Z}gm, where y and (z, Z) solve respectively 
(E553) and (227) with sı = 0 and s2 = T, and noting that y(T) = 0 in G, 
a.s., we obtain that 


-E f Gec)edro E] f (u 2)andedt 
G (s,T)nE J Go 
Choosing ys = —2(s) in (55), we then have 


f Iz(s)]gm do = J / (u, Z) pm dzdt 
G (s,T)NE J Go 


< |u| re» (s,T;L2(2;L? G;Rm))) [X(s.T)nEXGo 2| Li (T; L2 (0522 (G;R))) 






























































1 
: 2 
<e(s)(& | ls)lksaz) IX(sr)nEXGo 2| r2 (s,T; L2 (0522 (GR): 
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which gives immediately the desired estimate (54). o 


As an easy consequence of Proposition LIJ, we have the following unique 
continuation property for solutions to (ZA) with s; = 0 and s2 = T. 


Corollary 9.16. If m((s, T) N E) > 0 for any s € [0, T), then any solution 
(z, Z) to (EZ) with sı = 0 and sz = T vanishes identically in Q, a.s. provided 
that z = 0 in Go x E, as. 


Proof: Since z = 0 in Go x E, a.s., by Proposition LIA, we see that z(s) = 0 
in G, a.s., for any s € [0, T). Therefore, z = 0 in Q, as. LI 


Remark 9.17. If the condition m((s, T) Y E) > 0 for any s € [0, T) was not 
assumed, the conclusion in Corollary LIÐ might fail to be true. This can 
be shown by the following counterexample. Let E satisfy that m(E) > 0 and 
m((so, 7) NE) = 0 for some so € [0, T). Let (z1, Z1) = 0 in (0, so) x G, a.s. and 
£2 be a nonzero process in L2(so, T; IR") (Then Z2 = ge, is a nonzero process 
in L2(so, T; L?(G; IR"))). Solving the following forward stochastic differential 
equation: 


dé, — A161dt = —[a(t) ! & + b(t)' &j]dt + £aW (t) in [so, T], 
G1 (so) = 0, 


we find a nonzero 61 € Lz(Q; zs T]; R?)). In this way, we find a nonzero so- 
lution (z2, Z3) = (C1e1, €2e1) € L2(Q; C([so, T]; L?(G; R))) x D2(so, T; L?(G; 
R™)) to the following forward stochastic partial differential equation: 


n 
dz3 + > ( (af! zo d] Lk dt 


j,k=1 
—[a(t)' z2 + b(t)' Zo]dt + ZodW(t) in (so, T) x G, (9.57) 
=0 on (so, T) x I, 
22(80) = in G. 


(Note however that one cannot solve the system (EA) directly because this 
system is not well-posed). Put 


(z, Z) _ D j (0, so) x G, 
(22,22), in (so, T) x G. 


Then, (z, Z) is a nonzero solution to (G27) with sı = 0 and sy = T, and z = 0 
in Go x E, a.s. Note also that, the nonzero solution constructed for the system 
(57) indicates that, in general, the forward uniqueness does NOT hold for 
backward stochastic differential equations. 
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We are now in a position to prove Theorem BA. 


Proof of Theorem (ZY: Similar to the proof of Theorem LI, the “if” 
part follows from Corollary £16. To prove the “only if? part, we use the 
contradiction argument. Assume that m((so, T) E) = 0 for some so € [0, T). 
Since the system (ELZI) is approximately controllable at time T, similar to 
the proof of Theorem LIY again, we deduce that any solution (z, Z) to (227) 
with sı = 0 and sg = T vanishes identically in Q provided that z = 0 in 
Go x E, a.s. This contradicts the counterexample in Remark BTA. oO 


9.3 Controllability of a Class of Stochastic Parabolic 
Systems by one Control 


In this section, we consider the controllability problem for a class of coupled 
stochastic parabolic systems by using only one control. We shall see that, 
quite different from the deterministic setting, the controllability of this sort 
of stochastic partial differential equations is NOT robust with respect to the 
coefficients of lower order terms. This section is based on the paper [219]. 

We are concerned with the following controlled linear coupled stochastic 
parabolic system: 


n 


dy — 5 (af Ys, )a, dt 


j,k=1 


= [ai (t)y + a2(t)z + Xau] dt + [as(t)y + a4(£)2] dW (t) in Q, 


TL 


dz — 5 (a 25, audi (9.58) 
jk-l 
= [as(t)y + ae(t)2] dt + [az(t)z + ag(t)y] dW (t) in Q, 
y=z=0 on 2 
y(0) = yo, 2(0) = zo in G. 


Here, u is the control variable, (y, z) is the state variable, (yo, zo) € L?(G)) x 
L?(G) is any given initial value, a; € Lg? (0, T)(i = 1,--- ,8). In (E:58), the 
control u acts only on the first equation directly, and the control space is 
L2(0, T; L?(Go)); while the state variable y may be regarded as an indirect 
control entering the second equation through both the drift term a5y and the 
diffusion term agy. 

By means of Theorem [LZ4, it is easy to check that for any (yo,zo) € 
L?(G)) x L?(G) and u € L2(0, T; L?(Go)), (£58) admits a unique weak solu- 
tion (y, z) € Dg(f2; C([0, T]; L?(G; R?))) N £} (0, T; Hå (G; R?)). 

We suppose that the coefficients as and ag satisfy respectively the following 
conditions: 
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Condition 9.1 There exist a constant lo > 0 and a nonempty interval I C 
[0, T] such that a5(-) > lo or as(-) € —lo on I, ae. 


Condition 9.2 There exists a nonempty interval I C I such that ag(-) — 0 
on I, a.e. 


Write 
A 2 4 6 8 
0159 lale ont) lait; (or +>_ lailzzs or) +>, lail?eor (9-59) 
i—1 i=3 1—5 i=7 


To simplify the presentation, we suppose that I = (tı, t2) for some tı and t» 
satisfying 0 < tı < t9 < T. 

We have the following positive null controllability result for the system 
(E58). 


Theorem 9.18. Under Conditions [U. 1HU.2, the system (58) is null control- 
lable at time T. 


On the other hand, we have the following negative result for the null 
controllability of (58). 


Theorem 9.19. The system (9.58) is not null controllable at time T provided 
that one of the following conditions is satisfied: 

1) as(-) =0 in (0, T) x Q, a.e.; 

2) ag(-) £0 in (0, T) x Q, ae. and 28. € rg (0, T). 


ag(-) 





In some sense, Theorem LIJ means that Conditions are also nec- 
essary for the null controllability of (9.58) to hold. 


Remark 9.20. Condition E.Tlis used to guarantee that the action of the control 
in the first equation of (EL5N) can be transferred to the second one through 
the coupling in drift term. Theorem LIJ indicates that the action transferred 
from the first equation to the second one should be good enough to control 
the second one. Indeed, the coupling in diffusion terms may destroy the con- 
trollability of (58). 


To prove Theorem E.TN, we consider the following backward stochastic 
parabolic system: 
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n 
da + 5 (afas, Jendt 
j,k=1 


= ( — aş(t)a — a2(t)b — az(t) K — a4(t)R)dt + KdW(t) in Q, 


TL 








dB + M (aBa, ),, dt (9.60) 
j,k=1 
= ( — as(t)o — a1(t)8 — as(t) R — as(t)K)dt + RAW (t) in Q, 
a -—-0 on X, 
o(T) =ar, B(T) = Br in G, 


where (ar, Br) € L7..(0; L(G; R?)). Clearly, (ELGU) is the dual system of 
(258). By Theorem ÆN, the equation (9.60) admits a unique weak so- 
lution (a, 8,K,R) € (L&(02; C([0, T]; L'(G; R?))) N L&(0, T; Ho (G; R?))) x 
L2(0, T; L?(G; R?)). 

By Theorem ETA, we have the following equivalence between the control- 
lability of (EL5N) and a suitable observability estimate for (Z560). 


Proposition 9.21. For any T > 0, the system (E-58) is null controllable at 
time T if and only if solutions of (50) satisfy the estimate: 














qv 
la(0) Bao) + 18O)Ba¢c) < CE f [ Sr sd, (9.61) 


for any (ar, Br) € L}, (2: L*(G: R?)). 


'The corresponding controllability problem might be quite difficult when 
the coefficients a;(t) (i = 1,---,8) in the equation (E.58) are replaced by 
a;(t, x) (i = 1,--- ,8), respectively. The reason is, as we explained before, the 
controllability of (ELS) (needless to say the above general case) is not robust 
and therefore, it seems impossible to use the Carleman-type estimate to treat 
this problem. On the other hand, it is clear that the usual spectral method 
does not work for the general form of (59) (when its coefficients are both 
time and space-dependent), either. 


9.3.1 Proof of the Null Controllability Result 


This subsection is devoted to a proof of the null controllability result, i.e., 
Theorem LTA. Similar to the proof of Theorem B, it suffices to establish the 
analogue of Propositions (for the system (E:58) or (E.GU)). 

In the sequel of this subsection, {A;}92,, (ei 94, A, (with r > A1) and 
IL, are the same as that in Subsection BEZI. 

First, let tı < sı < s2 < t2 and m EN. Consider the following backward 
stochastic parabolic system: 
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TL 
da + 5 (afas, )epdt 
jk-l 


= | — ae(t)a — aa(t)8 — az(t) K — aa (t) R| dt + KaW (t) in (s1, 82) x G, 


n 


dB -- V (a?* Be, )u, dt 
jk-l 
= | — as(t)a — a1(0)8 — as(t) R — ag(t) K|dt + RAW (t) in (s1, 82) x G, 
a=8=0 on (51,52) x I, 
a(s2) = asz, B(s2) = Bs; in G, 


(9.62) 
where (05,, 85,) € Lx (2; H2) (Recall (£28) for the definition of H2). 
Similar to Propositions E.TZ, we have 


Proposition 9.22. Under Conditions [U-1H2.2, for each r > A1 and (a,, Bsa) 
€ Lx (2; H?), the solution (a, B, K, R) to (9.02) satisfies that 






































Cev" 
; 2 ) z 
E [a(s1)|r2(c + ElB(s1)lz2(o) € (52 — 81)> 


52 
J B(t,ax)^dxdt. (9.63) 
S1 Go 
Proof: We divide the proof into several steps. 
Step 1. For any (a5,, s2) € L}, (9; H7), write 
Aso = 5 oj, ei, Ds, = 5 Bi €i» 


iC A, iC Ar 


where af, and 61, are suitable F,,-measurable random variables. Then the 
solution (a, K, 8, R) to (262) can be represented as follows: 


a= 5 o((t)e, K= 5 K’ (tje B= 5 Bte R= 5 R'(t)e;, 


ic A. ic A. ic A, ic A. 


where (a, 8*, K*, R*) € L2(02; C([si, sa]; R2)) x L2(s1, s2; R?) solves the fol- 
lowing backward stochastic differential equation: 


do? — dja dt 

= [-ae(t)a? — as (t)&* — az (t) K? — a4 (t) R'] dt + K'dW(t) in (51,52), 
dp? — Aip’ dt 

= [-as(t)o* — a1(t)8* — as(t) R* — as(t) K*] dt + RAW (t) in (1, 82), 
af (9) = a, B (s2) = Bi. 


From Lemma LM, it follows that, for a.e. t € (0, T) and w € N, 
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297 
ri blt, x}? de = X` IOP < ost | | 5 8 (e (x) | d 
G i€A, Co i€A, 
(9.64) 
=Cev" | B(t,x)*de. 


Go 


On the other hand, note that (ELGZ) is a special case of (SZA). Hence, 
similarly to (EL3T]), recalling (59) for the definition of r1, we see that, for any 
tc [51; 82], 

















E J la(s1,2)? + B(s1, 2?]dz < e=) 
G 


“i 


H 











o + B(t,v))|da. (9.65) 
G 

Step 2. We establish a local estimate for a (See (E-GG) below). To this 
aim, we choose a function € € C??[s;, s2] with £(s1) = (se 


O 

) = 0 as follows 
E(t) = (t = s1)? (sa — t)’. 
By (T62), we have that 


d (£a) 


TL 


= &ofdt — £a| V (af Br, Joy + as(t)a + a1 (t) 4 as (t) R + as(t) K | dt 
jk-l 





-&8| D> (alas, Joy + as(t)o + ax(08 + ar(t)K + as (0) R] dt 
jk-l 


+EK Rdt + £oRdW (t) + £8KdW (t). 


(small) positive constant £, we find that 


J no 

$1 G 

J ] odia 2 
S1 G 


s2 
z 1 f £(KR — aaf — azaR — asaf — azp? — azBK a48R) adt. 
S1 G 


l $2 $2 3 . 
< Op 2 +E 3 (7-2 Jat) 
< a [ ian € f i (K + > Aila’ (P) deat 


i€ A; 
f^ | Bazat EE [^ f e (e Y Ade OP) deat, 
€ 81 G E $1 G 


i€ A; 


Therefore, by Condition (which leads to ag(-) = 0 on (t1,12)), for any 





























Xj 











[is Y dia’ (08 (t)dt 


iC Ar 











-+ 



























































This, together with Condition BJ, implies that 
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l 22 
af ] ian 


< [2 (I? + > aila) P?) deat T 


ic A, 


n JN [ axi + Se f fe (+o AlE P)dzat. 


iC A, 























ur 





























Step 3. In this step, we estimate the first and the third integrals in the 
right hand side of (50). Noticing that 


d(£8o?) = etga dt + 262 aK dW (t) + £? K?dt 


TL 


-2€2. Cee tag(t)a+ag(t)3+a7(t)K +a4(t)R| dt, 


j,k=1 





we obtain that 


e f eiae [P7 €? V7 Ail (t) Pat 
$1 G S1 


iC A; 


























3 


= se” 4 cotdeat + 28 f [ie (aga+a28+a7K +a4R) dadt. 
sı JG 


Hence, 


























af J dean JE 8 Y Aja (t) Pat 
S1 G S1 


nds (9.67) 














«ef ] 6 «P + eta 
S1 G 


On the other hand, by 


d(£3 8?) = se Paga + 26? BRAW (t) + £? R?dt 





-2626| Y (a?* Be; Jen +as(t)a +a (£) 8--as (£) RA as(t)K] dt, 


jk-1l 
and using Condition again, we obtain that 
$2 í $2 i 5 
ef J è Raar f € Y dj|6*()|?at 
S1 G S1 i€ A, 


=- f É pasats f © S E Blas(Data tti + alh R]dna 
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Hence, for any (small) positive constant 6, it holds that 


J | masas af E? Y^ Xje'(op at 
$1 G S 


1 i€ Ar 


<6 J Í £o? dzdt + G e | B? dxdt. 
$1 G ò S1 G 


Combining (T60), (ELG7) and (EG), by suitably choosing £ and 6, we find 


that m m 
af n £o? dzdt < C af i f dxdt. (9.69) 
S1 G $1 G 


Choose s3 = 81+(s2—81)/4 and s4 = s2—(s2—s1)/4. Then, sı < 53 < $4 < $2. 
From (E569), we see that 


S4 "e $2 
E a?dadt < ———4 af / ? dadt. 9.70 
[ i: E (s2 = s) $1 G 8 


Step 4. Integrating (2545) on (53, 54) with respect to the variable t, we 
obtain that 


























(9.68) 










































































E | a(s.2)%de+E | a(s1.2)%de 


B a" : 
8-5 [ ] ioo + F(t,z)?]dadt. 


By (E-7U)-(E-71) and (54), we obtain that 


(9.71) 









































af a(sı, z)?da + ef B(s1, c)? da 
G G 


C 5a 2 
« ——__E 
S Gon» [ [pea dxdt 


Cyr $2 
< SE f Blt, a} dzdt, 
(s2 m 81) S1 Go 


which gives (ELG3). This completes the proof of Proposition LZA. L1 




















Next, we consider the following control system: 
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dy — 5 (af y...) dt 


j,k=1 
= (ai(t)y+ ag(t)z+ xau) dt + (a3(t)y+ a4(t)z)dW (t) in (51, $2) x G, 
dz — » (a 25) di 
j,k=1 
= (as(t)y + ac(£)z)dt + (a7(t)z + ag(t)y)dW (t) in (81, $2) x G, 
y=z=0 on (51,52) x T, 
y(s1) = Us; 2(81) = Zs in G. 


(9.72) 
Here y4,, Zs, € Le (£2; H,). 
Proposition implies the following partial controllability result for 
ET. 


Proposition 9.23. Let Conditions [V.1H27.2 hold. Then, for every r > A4 and 
Ysi; Zs; € L}, (2; Hr), there is a control up € L2(s1,82;L7(Go)), such that 
the corresponding solution (y,z) to (X) with u = u, satisfies 


IT, (y(s2)) = IT. (z(s2)) 2 0 in G, a.s. 
Moreover, u, verifies 


eC vr 











E (Ius) f£, + le(s1)IBa¢@) - 





oO 


2 
lur|E2(s1,s2;L2(G0)) S RP 
'The proof of Proposition is very similar as that of Proposition 
(follows from Theorem [T7)), and hence we omit it here. 
Further, as a special case of Proposition £14, we have the following decay 
result for (E72). 


Proposition 9.24. Let r > 1. Then, for any (ys, 2) € L}, (2; L'(G; R?)) 
with IT,(ys,) = H,(zs,) = 0, a.s., the corresponding solution (y, z) to (ŒA) 
with u = 0 satisfies that, for all t € [s1, s2], 


























E (Iy(£) [22 (oy + ltiz) « e Qr-n)(t-a1) E(|ys, aes + he Baak 


Based on Propositions B.22-E.24, one can give a proof of Theorem 
similar to that of Theorem BJ, and therefore we omit the details here. 


9.3.2 Proof of the Negative Null Controllability Result 


In this subsection, we show the lack of null controllability for the system 
(9.58), presented in Theorem DTU. 
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Proof of Theorem [V. 13: First, we prove that the system (L59) is not null 
controllable if as(-) = 0 in (0, T) x £2, a.e. 

Without loss of generality, we may assume that the coefficient ag(-) in the 
system (5A) is equal to 0 (Otherwise, we introduce a simple transformation 
J = y, 2(t) =e Jo 26(53)45 ^ (1) and à = u and consider the system for the new 
state variable (g, 2) and the control variable à). Then, by the system (E:58), 
and noting that as(-) = ag(-) = 0 in (0, T) x 2, a.e., we find that (Ey, Ez) 
solves 




















3 













































































(Ey) — (a?*( Ey)a;) ay E(a;(t)y + ax(t)z + Xau) in Q, 
j,k=1 

(Ez); — (a ( Ez); ) ap =0 inQ, (9.73) 
j,k=1 

Ey = Ez = 0 on X, 

(Ey)(0) = yo, (Ez)(0) = zo in G. 
































Since there is no control in the second equation of (EL73), Ez cannot be driven 
to the rest for any time T if zo zz 0 in G. 

Next, we prove that the system (58) is not null controllable if ag(-) 4 0 
n (0, T) = (0, T). 

In the following, we construct a nontrivial solution (a, 8, K, R) to (ELGU) 
such that a5(t)a + as(t) K = 0 and (6, R) = 0 in Q, a.s. For this purpose, we 
consider the following linear stochastic differential equation: 








a eee ai (i in (0,T), 
(9.74) 





¢(0) — 1. 


Denote by ¢ € L2(0; C([0, T])) the unique solution to (9.74). Write q = C(t)e1, 
then it is easy to check that q € L2(0; C([0, T]; H?(G) N A} (G))) solves 


as(t) 








dq Y (a%a,),, dt = aot) yt) in Q, 

a (9.75) 
q=0 on X, 
q(0) = e in G. 


(Similarly to (E-37), one cannot solve the system (G74) directly because it 
is not well-posed.) Furthermore, consider the following backward stochastic 
parabolic equation: 
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dv + s a vy.) = ag(t)udt + VdW (t) in Q, 
j,k-1 
(9.76) 
v=0 on X, 
v(T) = C(T)ei in G. 


By the well-posedness of the equation (ELT8), it is easy to check that the 
solution (v, V) to (9.76) satisfies that v — q and V — — igi in Q, a.s. 

It is easy to check that (a, 8, K, R) = (v, 0, V, 0) solves the equation (ELGU) 
with (ar, 8r) = (¢(T)e1,0). However, E[o(0)[22 (y — ]. This implies that 
(261) does not hold for the solution to (E-GU) associated with the above 
(ar, br). By means of Proposition EZI, we deduce that, the system (5) is 
not null controllable. LI 

















Remark 9.25. Notice that by Theorem EIA, when ag(-) = 0 and as(-) = 1 on 
(0, T), a.s., the system (58) is null controllable at any time. On the other 
hand, Theorem LIY shows that no matter how small the nonzero bounded 
function ag(-) is, the corresponding system is not null controllable any more. 
This indicates that the controllability of the stochastic coupled system (5A) 
is not robust with respect to the coupling coefficient in the diffusion term. 
Moreover, by Condition EZ, we see that if the coefficient ag(-) equals to zero on 
some time interval with an arbitrarily small (but still positive) measure, then 
(E-58) is null controllable again. Therefore, the controllability of stochastic 
coupled parabolic systems is influenced strongly by the coupling coefficient 
in diffusion terms. Also, it indicates that it is very hard (even impossible) to 
apply the Carleman estimate to prove Theorem UTA. 


9.4 Carleman Estimate for a Stochastic Parabolic-Like 
Operator 


This section is addressed to deriving a Carleman estimate for a stochastic 
parabolic-like operator (to be given below), which will play key roles in the 
sequel. The main content of this section is taken from [B15]. 

Throughout this section, we assume that 


pi^ = pk € Lg(02; C! ([0, T]; W>% (G))), j,k — 1,2,--- Tb, (9.77) 


L € C13(Q) and V € C1? (Q). Write 
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TL 


mem D (blag lar bik s, 7 blee) — WV -—h, 


j,k=1 
= 2| Aav - Y (Abla), h]-^- Y (ws), (9.78) 
jk-1 jk-1 
; 2p)" (b Fe pikpik g be wor, 
ich zy) T TM a 


First, we establish a fundamental weighted identity for the stochastic 
parabolic-like operator “d — D pai Ox, (07 gs )dt”™, in the spirit of the point- 
wise identities (C48) and (1). 


Theorem 9.26. Let u be an H?(G)-valued Itó process. Set 0 = ef and v = 
du. Then, for any t € [0, T] and ae. (z,w) € G x 22, 


20| a 5 (Pus + Ay] [du — Y (bu... dt| 
jk-l jk-l 
+2 x: (bitva dv), +2 > | y (20/5 K ly Va Vay 
j,k=1 jk-1 j',k'=1 


DIr F la Ve Vay) + Pbv, v = vt ( 








V... 
m ? )v?] dt 
* 2 Lk 


" (9.79) 
= LER Evo va, dt + Bv?dt + d( 3 pik Va; Vrk + Av 2) 
j,k=1 
zl|- : (bv...) + Ay] at 
j,k=1 i 


—8? V WF (dug, + ledu) (dus, + 6, du) — 6? A(du)". 
jk-1l 

Proof: The proof is divided into four steps. 

Step 1. Recalling 6 = ef and v = ĝu, one has du = 0^! (dv — (,vdt) and 
Uz, = 0 l(v,, — lev) for i = 1,2,--- ,m. By (E72), it is easy to see that 
5 DI (lo, Var + y,Va2;) = 2 5 POL Van Hence, 
j,k=1 j,k=1 


1 Since only the symmetry condition (EL77) is assumed for the coefficient matrix 
(0^), we call “d — »77, Ox, (P On, )dt” a stochastic parabolic-like operator. 
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0 Y^ us.) Je, — 0 Y^p 0 t (va, — E, Vlar 


j,k=1 j,k=1 
[DĂ (va, — £,v)]a x b (va, — E, Vlar 
j,k=1 j,k=1 
= Y [Gv — Pss P) Pn) 
j,k=1 
(b sso, — bR la; — blaja )¥| 
= Y, [O*ve, on — 2054, Ven + 0755,45, — la, — 056a yv]. 
j,k=1 
Put 
[i 5 (D^v,), HAV, Rh E |- 5 (Pv an + Ay] dt 
j,k=1 j,k=1 
. (9.81) 
A jk A 
In=dv +2 5 OPEL. Vandt, I3 5 Vvdt. 
jk-1l 
By (EL8U) and (80), it follows that 
6|du =e Pt) dt Sht bai 
j,k=1 
Hence, 
2| - (bv, Jes + Av] [du - Y (b*u,,) jadi] = =21(1, + h + Å). 
j,k=1 j,k=1 
(9.82) 


Step 2. Let us compute 21/75. Utilizing (272) again, and noting that 


TL n 


5 (DEDI Le eg = 5 (BFO E Lose riis 


j,k,j’',k'=1 j,k,j',k'=1 
we get 


n 
ilc 4! kl 
2 ) b b Us Vej Vaga; 
Jj; k,j',k'—1 


TL 
15 ;' k^ 
= J Up lr (Vz; Vane, + Vek Veje) 
j,k,j',k'=1 
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n 
ik ;' k^ 
= X bI DI Us s (Vu; Va.) (9.83) 
j,kj'.k'— 
n n 
` jkpj’k' 5 ea a" hl 
= (b b lr Vas Ver args bid (b b! s )mp Vn; View 
ik, jk = j,k,j',k'=1 
n n 
jk pj’ k' TIU 
= SOP a veel x, QUU LOL V vae 
j,kj'.k'— j,k,j',k'=1 





Hence, by (E.&3), and noting that 


n nm 
5 DE (IF la a, Vag Va = 5 pik’ OG Day Va; Vrk’ 
jj! j,k,j',k'=1 
we obtain that 
n ] n ; 
al — 5 (Eva de + Ay] 5 bF la Var 
j,k=1 j,k=1 
zc 5 (EDI by Va Vay Jew +4 Y a Tuo aas 
j,k,j',k'=1 j,k,j',k'=1 
n TL 
44 YO OO A vo vas AA M ERE (2s 
j,k,j',k'—1 j,k-1 
=-2 5 | 5 (2075 p k lr Var Vas — py * Uo Ving: Vu) (9.84) 


jk=1_j',k'=1 


Abi lv?) aS Be ay RF eu aay 
TR ghy k= 
—2 V (Abla, JanV’. 
j,k=1 


Using Itô’s formula, we have 


TL 





?|- p» (b vsus + Ay] dv 
jk-l 
=-2 3 (b^ va dv);, +2 y b^ y, dva, + 2Avdv 
j,k=1 j,k=1 
p (9.85) 
= -2 Y (Uv. dv), + a( Y Pe, Veg + Av’) 
jk-l j,k=1 


— 5 b]^ v, v.s, dt — Ayv? dt — 5 bi^ dv... dvr, — A(dv)?. 
j k-l j,k=1 
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Now, from (EST), (84) and (8H), we arrive at 
2IT» 


n n 
ik j^ k’ ik "d 
=-2 1 | 1 (20? b! le Vg Yzy — 0 bI lo; Nias Vap) 
jk=1 jhk-1 


-Ab lv?) dt —2 5 (D^ va dv);, 4 a( > b Vn Ving + Av?) 
i j,k=1 j,k=1 
+2 Y | 5 (20 (90, = (t = UM Va, Vendt 


2 
jk=1_j',k'=1 


-|A +2 j* (Av, en | vat = 5 b" dv, dvg, — A(dv)?. 


j,k=1 j,k=1 
(9.86) 
Step 3. Let us compute 2/73. By (ELRII), we get 
2TI3 = 2| — 5 (bva er + Av] Vvdt 
jk-l 
= |-2 5 (Pove v), 12V 5 Urs 
j,k=1 j,k=1 
+ YT Pia at 24v? dt (9.87) 
j,k=1 
= { = (29v, v -— bU, v?) + 2v 5 DEVa Var 
jk-1l zs jk-1l 
di | - V (E, s + 2AU] v hat. 
j,k=1 


Step 4. Finally, combining the equalities (E-EZ2), (28H) and (287), and 
noting that 


5 b^ dv. dv, + A(dv)? 


jk-1 
— 9? V bh(du,, + £,, du)(du;, + £,, du) + 0° A(du)", 
j,k-1 


we conclude the desired equality (79) immediately. This completes the proof 
of Theorem EZA. o 
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Next, we shall derive a Carleman estimate for the stochastic parabolic-like 
operator “d — $75, 4 On, (^0, dt”. 2 

For any fixed nonnegative and nonzero function 7 € C^(G), and (large) 
parameters À > 1 and u > 1, we choose 





" j m eub) enl teo eub) 
€, Q, a( 22] t(T — t) i 2 2) t(T —t)' 
(9.88) 
and " 
(9 Daer- (9.89) 
j,k=1 


In what follows, for a positive integer r, we denote by O(u”) a function of 
order u” for large u (which is independent of A); by O,(A") a function of 
order A" for fixed and for large A. In a similar way, we use the notation 
O(etl¥le@) and so on. For j,k = 1,2,--- ,n, it is easy to check that 


& = As, bs, = Apis, Lejer = A posu, FAV, — (9.90) 


and that 
ar = p O(t), pe =p O(e" loc), (9.91) 


We have the following result. 


Theorem 9.27. Assume that either (07*)n en or —(bF)nxn is a uniformly 
positive definite matrix, and its smallest eigenvalue is bigger than a constant 
so > 0. Let u and v = 6u be that in Theorem ZZA with 0 being given in (BR). 
Then, the equality (Z) holds for any t € |0, T] and ae. (x,w) € Gx Q. 
Moreover, for A, B and c)" appeared in (ŒA) (and given by (E-TB)), when 
|Vy(x)| > 0, A and u are large enough, it holds that 


A = -Xup X bi, Vs + dy?0(e7H¥lo@), 
jk-l 
B > 2s 9|vwy[ + 3930(u3) 


OMM eins (9.92) 
430(pe ulvlo@)) + AgjO(e nlle), 


NO ct vava, > [tA el Vol + xeO(u)]| Vul? 
j,k=1 


for any t € [0, T], a.s. 


Proof: By Theorem LZA, it remains to prove the estimates in (92). 
Noting (ELEU)-(E-UU), from (EL78), we have ls e, = AH?’ PPr; Vs, +APO(H) 
and 
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n 
jk 
J C^ Ve, Vep 
j,k=1 


TL TL 
d 


ex J pt a quip se pou. 
jk-l ` j',k'=1 
jk 


PE oy lay | s 
= > { 3 [2A u gb B gs abs Apfel ah Poy | 
j,k=1  j',k'=1 
+Ap0(1) Wa; Vas 
= 2xPe( » bus va) + ?o( 3 b, ben ) ( 3 bv, va) 
j,k=1 jk-l j,k=1 


+Ay|Vv|?O (11) 
> [su e| VU? + AgO(u)] Vvl^, 


which gives the last inequality in (92). 
Similarly, by the definition of A in (E.78), and noting (SM), we see that 
A =— M (EE, lu, — EU, +0 lajer) — h 
jk-l 


TL 


=u» LIT — bi obs, +0 (ups, be, + LI 


jk—i 
+A? O (elte) 


=-X pP Y bis ar TAPO), 
j,k=1 


Hence, we get the first estimate in (192). 
Now, let us estimate B (recall (@78) for the definition of B). For this, by 
(90), and recalling the definitions of V (in (ECEJ)), we see that 


n 


Y= 2u Oppa Par Unio.) 
j,k=1 


=2App V i, ex +ApO(u); 
j,k=1 


[EM = ME gb Poy Ver TE AgO(p’), 
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lr ays aj en = Au vb.) Vs, Wx; Way F AvcO(u Py, 


Wo, = =2 Pt (b ism abes] mE —2 Y 0 bj we bss j! Vk! + ae oon) 


j',k'=1 j'k'—1l 


los 2AL? > b as Pay Var F ApO(u"), 


j ,k'=1 


p 
Vn, =2 J ba, bg jl Uk. + pik = ji Ua LiLk T 2b; lapas) 
gt = £ 


= YN at) 5 DIF wp, besos F AeO(u), 


j'k'—1 
= > (Par) », ~ 2. (bs, TU, 524) 
jk-1 j k-l 
4 S jk ? 3 


j,k=1 


Hence, recalling the definition of A (in (EL7N)), and using (90) and (€), 
we have that 


rs 2 
Ap = -2x ut? ( 2 b, s) +A POl?) + AO lelo), 
j,k=1 


Ag EG UL EP EL A vot dcc Eu 


Lp Lk Tk! 
j',k'=1 


i' k! j! k’ 
+b, lz ray TU [n — bra, 
TL 


—— M (QU Lus, EO eese.) -her + Apt P)O) 
j'k'—1 


— 2X4? V Mu s Dae +A PO) + AP O(ue? leen), 


j',k'—1 
n T" . 2 
EUN LU = 223 4g? ( 5 b, bar ) tA Olu”) 
j,k=1 j,k=1 
+420 (p? e?nliloce, ). 
XO (A*6,) E As, DL, +A Y( (DÍE la, + blaja) 
j,k=1 j,k=1 j,k=1 


c" 2 
= -3x3 ut ( 5 b, s ) + By? O(u3) + Xu O(u? e? lec). 


jk-1l 
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and that 


A=- 5 (bloglar — bik las +b lager — be), 


j,k=1 
=- Y reus), — Raye + laast 
j,k-1 
JX320(u?) + Ap? O (e? lec) 
= 3 O(p2e7Hl¥le@) 4 Ag O(e?I lec), 
From the definition of B (see (EL78)), we have that 


ee 2 
Hs xus p. b. s) +A POl) + XP O(u? elec) 


jk-l 
n F 2 
oaut ( DO Westen) HAPO) X Oo) 
j,k=1 
elle) + AO (ello) 











+° 30 u? 


-auto( So Peja) + APU) 
( 


j,k=1 


no 2 
203 up? > bj, tbar ) +A” POl”) 
j,k=1 
A298 o (pelle) + AO (e?" lec j^ 


which leads to the second estimate in (E.92). Li 


9.5 Observability Estimate for Stochastic Parabolic 
Equations 


In this section, we shall establish an observability estimate for the stochastic 
parabolic equation (I0). The main content of this section is taken from 
PIS, B15). 

We have the following result. 


Theorem 9.28. Let the condition (ZIM) be satisfied. Then, solutions to 
(CIO) satisfy that, for any zo € L2 (9; L? (G; R”)), 
2 
|2(T)lz2_ cosa < CeE™|2|1200,7;12(GoR™))> (9.93) 
where Ro is given in Corollary TA. 


We shall give a proof of Theorem in Subsection B.5:3. For simplicity, 
we consider only the case m = 1. 
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9.5.1 Global Carleman Estimate for Stochastic Parabolic 
Equations, I 


In this subsection, as a preliminary to prove Theorem LZA, we shall derive a 
global Carleman estimate for the following stochastic parabolic equation: 


TL 


dh — X` (a/^h,,),, dt = fdt + gdW(t), in Q, 
j k-1 


h = 0, on A, 
h(0) — ho, in G, 


(9.94) 


where ho € L} (2; L?(G)), while f and g are suitable stochastic processes to 
be given later. 

We begin with the following known technical result (See [IT7, p. 4, Lem- 
ma 1.1] and B37, Lemma 2.1] for its proof), which shows the existence of a 
nonnegative function with an arbitrarily given critical point location in G. 


Lemma 9.29. For any nonempty open subset G4 of G, there is ay € C®(G) 
such that Y > 0 in G, v =0 on T, and |Vv(x)| » 0 for all x € G \ Gi. 





In the rest of this section, we choose 0 and £ as that in (ELEB), and w given 
by Lemma with G being any fixed nonempty open subset of G such that 
G4 C Go. The desired Carleman estimate for (Z) is stated as follows: 


Theorem 9.30. There is a constant uo = uolG, Go, (a?")nxn,T) > 0 such 
that for all u > uo, one can find two constants C = C(u) > 0 and Ao = Ao(u) > 

0 such that for any A > Ao, ho € L5 (05 L7(G)), f € LẸ, T; L^(G)) and g € 
L2(0,T; H1(G)), the corresponding solution h € L2(;C([0, T]; L?(G))) ( 
L£(0,T; Hà(G)) to (LUA) satisfies 


























A^ ef 0^ o3 h?dadt + AJ? f 0°p|Vh|? dxdt 
* k (9.95) 














«ce[ [A (f+ (Vol? +X Peg? dadi eoo! f Past. 


0 


Proof: We barrow some idea from [IT7]. We shall use Theorem EZA with 
bJ* being replaced by a^ (and hence u = A). The proof is divided into three 
steps. 

Step 1. Integrating the equality (E-7H) (with b/* replaced by aff) on Q, 
taking mean value in both sides, and noting (ELUZ), we conclude that 


TL 


fel = S (ava, Av] |an- 7 (hs), dt] dz 


j,k=1 j,k—1 





x 
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+2E a a (afv, dv) Ja, d 


Q j.k—1 








TL TL 


: TEL d y ap 
ex | ` | > (2a a? la Vz; ay, — a)" gi fous 
Q jk—l j'kt-1 




















+alv, v — aft ( T )v?] dxdt (9.96) 
Tk 














> 282E a [OITU + OW) IV? + e (29 |vul* +A Ol) 


id ded t AO (e?!Hlecn)) v? ] deat 














+2E f Lass (at! Neck + Av} dadt 
im 1 


























= Ji 9? 3 a" (dhe, + lx;dh)(dha, + lx,dh)dx — E J) 0? A(dh)? da: 
Q 


j;k=1 


where 


n 


= 5 [us lar > ais. + a san) — hi, Y =2 5 alay 


j,k=1 j,k=1 
By (8.94), we find that 


n 


JL | - X (at! Vz; Jax + Av] [ah -2.í (a! s. s, dt | de 
-2 f o [- 
= 26 f o [- 


<E l-5 (o P dtdz + E a | P Patan, 
j,k-1 Q 





E 

















(a?*v,,) Jo, + Av| (fdt + gdW (t)) da: 


3; 1 


(9.97) 

















(aj* v...) Jap + Ay] fdtdx 
1 


j, 


























Since h|s = 0, we have 


v|x =O and v} |5 = 0h;, s = eu : 
? Qv Ix 


Similarly, by Lemma ZJ, we get 


Ob, 


ð 
lz; = Mus, = ALP” is 


and a on X. 
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Therefore, utilizing integration by parts and noting v|x — 0, we obtain that 


af P» (afv, dv), dx = 2E Í » al^ v, v^dvdx = 0, (9.98) 


Q j.k—1 j,k-1 








E 




















and that 


k j'k' jk j' k' 
Ji > | J (2a af la Vej Vey — 0 aj " L, je 


Q j k= 1 j'k'—1l 





x 

















Hal * v.v — at z je. dtdx 


«9 


= =æ | i J (2 2af a V Lz y Vag Vay — gita? V lr; Va, yas 


j k-1 j'k'—1 





+alv, v — att ( 5 v v^dI dt (9.99) 





Tj 


JH x > (2252! t bo, v va, — afa" by jig) |o dI dt 


X ik= 1 3',k'—1l 


-xyE | 9 oe (SR) x | 5 (245a! uil 


j'k'-1 





Il 
S 























alk at F yl yd y il v*dI dt 


= 2\pE [ee a (X ali^) ardt « o. 


j,k=1 














By (EA), we see that 


























Ji 9? 5 a/* (dhs, + £, dh) (dh, + le dh)dz + E f 6? A(dh)?dx 
Q 


j,k—1 


























H af e 3 a?*( (9; + 6,9 (Gx, + £x, g)dzdt + E J) 0? Ag? dxdt. 
Q 














j,k-1 
(9.100) 
Combining (EL98) -(E.TUU), we arrive at 
23 | [PARIT + AOUT + eeu + AOG) 
Q 
A20 (yu? e?" lec) $ AO (Helen) v?| dxdt (9.101) 














<E f [Pe S aga, toes + yg) + AG] dre 
Q 


j,k=1 
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Step 2. By Lemma £29, min;cc c, |Vv| > 0. Hence, there is a pig > 0 


such that for all u > uo, one can find a constant Ag = Ao(u) so that for any 
A> Xo, it holds that 


T 
E À 2 . V 2 O c ə 
J, kal e^ E om vl + ())| v| 
tye A3,4 : 4 3 ü 
P (^ pe ee TJ Se M) 


420 (p2e2HlYlew ) + AO (elec) v?] dadi 





N 











(9.102) 

















T 
2A J | e(IVwl? + Xy eh? )daat, 
0 JONG; 


where c1 2 min ( minzec a, IVV|?, minzec c, IVvI^). By 
hy, = 07! (vs, — £u, v) = 0 (va; — Apis, v) 


and 
Va, = I(he, + be; h)= (hz, + Aus, h), 


we obtain that 
1 
g” (Iva? + d?y? 7h?) < [Vv]? +X? upy? < ce (|Vh]? HAM. 


Therefore, it follows from (@102) that 














A J 0*o(|VA? + Mu? u? h?)dzdt 
Q 


T 
J (f «f )e(IVh[* + Xe? p? h?)dzdt (9.103) 
0 G\Gi Gi 


< c{ J [prvy + AO(u))|Vv|? v? (xuv + ¥O(u") 
Q 


bo 


























+70 (ue tlc) + AO (e?! len) v? | dxdt 
T 
AU af f 0?p(|Vh]? + Xp en?) dat}. 
0 Gi 


Now, combining (E.IUT) and (103), we end up with 























Au? ef *o(|Vh? + Mu? u7h?) dxdt 
Q 














< cE f eU? + [Vgl? + 21222) ded (9.104) 
- Q 

















T 
+e f | o(|VhI? + Xu*g?h?) drat]. 
0 Gi 
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Step 3. We choose a cut-off function ¢ € Cg? (Go; [0, 1]) so that ¢ = 1 in 
Gy. By d(6? ph?) = h?(0?5),dt + 20? phdh + 0? (dh)? recalling lim; ,9« y(t, -) 
= lim, ,q- q(t,-) = 0 and using (94), we find that 





























O=E] C[R*(0*p)dt + 20*hdh + 0*o(dh)?]dx 
Qo 
-E f 9C Wo, + 23904) 2h ( D> (hs, + F) + 99? | drat 
9 j,k=1 
=E / 6? [cn o, 4-2Ago4) — 203 5 a hy hey (9.105) 
9 j,k=1 


—2uC?p(1 + 2Ap)h 5 atha, Way 
j,k=1 


-AGph Y ai hasan, + 202 pf + og dxdt. 
j,k=1 
From (ELIUS), we deduce that, for any £ > 0, 
E f 0o X` ai h, Ne, dadt 
Qo 


j,k=1 





i) 























=E | 0 [Phoe + 230) — CC + 2d9)h > aha; they 
: j,k=1 
—4¢—h V af*h, C, + 20 fh + Cop deat (9.106) 


j,k=1 








X 


IA 
m 























J eo vhidzdt + € / e( js P XP?) drat 
o E Qo 2 H 














+e | 0? og? dadt. 


0 


From (ELTUG), we conclude that 


T 
J f 67 o|Vh|? dxdt 
0 Gi 


à 1 ` 
< clk LPS P+ 9”) deat + WE A 0^ oh? dadt |. 
0 


Finally, combining (104) and (10%), we obtain (95). o 


Remark 9.31. In Theorem EIU, it is assumed that g € L2(0, T; H1 (G)). This 
assumption is not natural. In the next subsection, we shall relax this assump- 
tion to be g € L2(0, T; L?(G)). 














(9.107) 
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As an easy consequence of Theorem L30, we have the following result. 


Corollary 9.32. For i = uo and any A > Ao(— Ao(uo)) given in Theorem 
TZO, ho € LÈ (Q; L*(G)) and f € L2(0, T; L?(G)), the corresponding solution 


0 


h € L2(0; C([0, T); L2(G))) N L2(0, T; Hi (G)) to (ŒA) with g = 0 satisfies 


























A^ J 6° dedt + XE | 0?o| V h|? dxdt 
Q Q 

< CE( f 6? f2dadt + X9 i: 0h? dadt). 
Q Qo 


Since the equation (YA) with g = 0 is a random parabolic equation, Corol- 
lary follows also from the known global Carleman estimate for determin- 
istic parabolic equations (e.g. [LT7]). Nevertheless, it seems that Theorem E30 
has some independent interest. 


9.5.2 Global Carleman Estimate for Stochastic Parabolic 
Equations, II 


In this subsection, we derive an improved global Carleman estimate for the 
forward stochastic parabolic equation (194). 

Throughout this subsection, yu = uo and A > Ag are given as that in 
Theorem E.3U, and 0 and q are the same as that in the last subsection. 

For any fixed f, g € Lz(0, T; L?(G)) and ho € L} (2; L?(G)), let h denote 
the corresponding solution to the equation (@94). Based on the Carleman 
estimate in Corollary E32, we give below a “partial” null controllability result 
for the following controlled backward stochastic parabolic equation: 


dr+ > (ara) a, dt = (X50 ’h + xa u)dt + RAW (t) in Q, 
j,k=1 
r=0 on X, (9.108) 


r(T) =0 in G, 
where u € L2(0,T; L?(G4)) is the control variable and (r, R) is the state 


variable. 


Proposition 9.33. There exists a control à € L2(0, T; L^(G1)) such that the 
corresponding solution (f,R) € (L$ (02; C([0, T]; L2 (G))) N Le(0, T; H3 (G))) 
x L2(0, T; L? (G)) to (EIUS) with u = ù satisfies f(0) = 0 in G, a.s. Moreover, 


























E | 07? (P + ATST a? + ACE) dadt < CXE f 6°? h? dadt. 
Q Q 
(9.109) 
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Proof: We divide the proof into several steps. 


Step 1. Write 














T 
u = fu € LÈ(0, T; L?’(G1)) | e f 0? ?u?dzdt < oo] 


eibG) — e2H bloc 
For any € > 0, write a, = a-(t,x) = (EXT — t4 6) and construct the 


following optimal control problem for the equation (ZIOA): 





inf ((u) | ue uj, 


where 














1 T 
= (f e? P dydt + xf | 0? ?u?dzdt 
2 Q 0 Gi 


+ i, r*(0)da). 


It is easy to check that for each € > 0, the above optimal control prob- 
lem admits a unique optimal solution (ue, re, Re) € U x L2(0, T; HÀ(G)) x 
L2(0, T; L?(G)). Moreover, 


Ue = Xa, A30? ze — inQ, as, (9.110) 


where ze satisfies 


n " 
zt- >> (a? ze ws) a, =e Ar. in Q, 
jik=1 


Ze = 0 on X, (9.111) 
1 


ze(0) = zre(0) in G. 


Step 2. We now establish a uniform estimate for the optimal solutions 
(ue, re, Re) wrt. € > 0. By (E.IUS), (ZI), Itó's formula and (E.IIU), it 
follows that 


























EE.. 


+ze (a? *re.0;)_, t 0099? A+ XG, e| }dzdt 


nm 
j,k=1 
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= J (po Pepe + BO zh + xo, 3059322) dxdt. 
Q 


This, together with the last equality of (ZIT) and Corollary 1.32, indicates 
that for any p > 0, 


































































































1 
J (e?e r2 + xa, 0*9? 22) dadt + E J r2(0)dz 
Q G 
==)? f 6° o> z-hdadt 
Q 
3 
< pr ef 030? 22dxdt + X J 0? h? dadt (9.112) 
Q P JQ 
< ps f n 0*3 z2dadt + af (eer. Para] 
33 0 Gi Q 
«ck | 0? 5? h? dadt. 


Notice that 92e-?^o« < 1. Therefore, by (£110) and (112), we see that 


























1 
J (e iu A 3079742) dadt + — af r2(0)dax 
Q E JG 


(9.113) 
< CXE / 6°? h? dadt. 
Q 














On the other hand, by the first equation of (ZIUN), it follows that 


d(e 99e p72) 
— (ee?) r2dt + e 2o o7? (dr. )? 


TL 


426720575, |- Y^ (atre 2) dt +070? Phat xa, usdt-- RedW (t)| 


jk=1 


This implies that 








Xj 




















TL 
x > aJ ros Te os didt 
Q 


J e 2957? R2dadt + 2 
Q j k-1 


























T 
= JI (9-7 ou ?)ddsdt — 28 | y» ai (ece o?) y ree Pend 
Q Q j,k=1 


























~2E j Pe pr. hdxdt — 2E f xa,€ Op ?rzu.dadt. 
Q Q 


Notice that e-?^o« < 072, By a simple calculation, we find that 
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À æ | e ?^9«(57? R2 dzdt + 2A æ f e ?9«57?IVr.l?dzdt 
Q Q 





























<e (ave f e AM p? dedt +A m f e ?^9«57! Vr. |Ir; |dzdt 
Q Q 


fe Ade (rte dat 
Q 


<À æ f e ?«57?IVr.l?dzdt (9.114) 
Q 











z] 




















+A J be> or. h|dxdt + A7? 
Q 





























4C J (e -3.,42 4 4739-2 Qul + Meus?) dxdt. 
Q 


Combining (114) with (ELTT3), we conclude that 





























J (e pe ccr? u2)dzdt 4- æ f e ?« 57? vr. dxdt 
Q Q 




















Ie»! 








1 
+ f r2(0)dz + A~? 
G 


: i 2àae 57? R2dadt (9.115) 
Q 














< CXE f 0h? dxdt. 
Q 


By (@115), and noting (@108), we deduce that there exists a triple 
(a,7,R) € L2(0,T; L?(G4)) x L2(0,T; Hd(G)) x L2(0,T; L?(G)) such that 
as e > 0, 

ug— à weakly in L?((0, T) x R; L?(G4)); 

ref weakly in L?((0, T) x 2; Hd(G)); (9.116) 

R.— Ro weakly in L?((0, T) x 2; L?(G)). 
Step 3. We conclude that (?, R) is the solution to (S108) with u = à. In fact, 
by Theorem ETI, the equation (IUA) with g = g admits one and only one so- 
lution (7, R) € (Lg(0?: C([0, T]; L?(G))) (1 L2(0, T; H1 (G))) x L2(0, T; L?(G)). 
Then, for any f; € L2(0, T; L?(G)) (i = 1,2), consider the following forward 
stochastic parabolic equation: 


- X. (a... dt = fidt + fodW(t) in Q, 
j,k—1 

dcm ouis (9.117) 
o(0) — 0 in G. 


By (ECIUS), (ECTT2) and Itó's formula, we see that 


320 9 Controllability and Observability of Stochastic Parabolic Systems 


























gf Aeh xa, à) deat + a fh + Rfa)dadt = 0. (9.118) 
Q Q 


Likewise, 


























E / O38? 9h + xa, Ue) odxdt + E I (ref, + Re fa)dzdt = 0, 
Q Q 


which, together with (ELIIG), indicates that 


























ef (30? p*h + xa, û)pdzdt + uU (efi + Rfa)dxdt = 0. (9.119) 

Q Q 

Combining (ELITS) and (ELITS), we see that ? = f and R = R in Q, as. 
Finally, by (ELITS), we obtain that f(0) = 0 in G, a.s. and the estimate 

(G10) holds. Oo 


Now, based on the above null controllability result for the backward 
parabolic equation (E-TUN), we show the following improved global Carleman 
estimate for (@94) (compared to Theorem E30): 


Theorem 9.34. For u = uo and any A 2 Xo given in Theorem [Z30, ho € 
L*.(0;L^(G)) and f,g € Lg(0,T; L?(G)), the corresponding solution h € 
1À(0: C(O, T); £2(@))) N L200, T; Hi(G)) to (CIA) satisfies 














J 0? (3o? h? + xg| Vh|?) dxdt 


<ce| f P? e P ptg?)dadt + 2° | 
Q 


Qo 


(9.120) 














Psi dadtl 


Proof: For any ho € L3 (Q0; L?(G)) and f,g € L2(0, T; L?(G)), let (f, 2 
be the solution to (ELTUR) "With u = &, which was given in Proposition EL3 
Then, by Itó's formula, we see that 


























A J 0? o h?dxdt = — af (xa, üh + f + Rg)dadt. 
Q Q 


It follows that for any p > 0, 














ME | 0*5 h? dadt 
Q 














£d d s 3974? 4- P* 4 A7? ^? f£) deat 
Q 
- beg i J 62y3h2dadt +E | 6? (f? + 202g?) dct]. 
tis 0 Gi Q 


By (@109), this implies that 
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3 f 0? h? dadt 
Q 


T 
EC pe J J 0? h? dxdt + J 0? (f? +x u?g?) dat]. 
0 Gi Q 


On the other hand, by Itó's formula, we have that 


(9.121) 


























d(62ph2) = (0p) ,h2dt + 26% ph Y (ai*hiz, )ogdt + fdt + gdW (t)) 
j,k=1 


+67 p(dh)?. 


Hence, for any p > 0, 


af Op M ahe he, dxdt 
Q 


jk-l 





N 























= af (9)? =92 5 a (P), hah + 20%phf + og") drat 
j,k=1 








<c f (A? 9h? + A? ? | VR|[h| + O7y|hf| + 0? yg") dadt 
Q 





























< æ f 0? 0| V h|?dzdt + 2 J 0? (A249 h? + A7! f? + og?) dzdt. 
Q P JQ 


By (@121), this implies that 





> 











f 0* 0| Vh|?dzdt 
Q 


T 
«cepe af | 02? h? dadt + J e? (f? +g?) daat]. 
0 Gi Q 


Combining (ZIZI) and (£122), we obtain the desired estimate (120). O 


(9.122) 


























Remark 9.35. By a similar method used in the proof of Theorem E one 
can show the following E Carleman estimate for (94) in H !-space: 
For u = ug and any A 2 Ao given in Theorem E30, ho € L4} (0; L?(G)), 
f € L2(0, T; H^! (G)) and g € L2(0,T; (3), the corresponding solution 
he L2(0;C([0,T]; L(G )(1L2(0, T; Hi (G)) to (GIA) satisfies 














J 0? (xg? h? + A7 o| Vh|?) dadt 
Q 


T a 
«cQ | f, 0? h? dxdt + J £^|0f [5 (adt + s | Pogana). 
1 
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9.5.3 Proof of the Observability Result 


We are now in a position to prove Theorem EZA. 


Proof of Theorem IZZA: Applying Theorem EL34 to the equation (18), 
recalling (@90) and the definition of «k2, noting also that we assume that 
m = 1, we obtain that, for u = ug and any A > Xo given in Theorem E.3U, 


bs J 9st + XE f 67 0|V2z|?dadt 
Q Q 















































e af | e Qus, 4 bos) X! (b52)* | dedt + XE n 0*5! dadt) 





























Ec [x2 J 0? (IV z|? + A? 2?) dadt + A’ J Pz? drat] . 
j Q Qo 





























(9.123) 
Choosing A = C(1 + K2), from (ELTZ3), we deduce that 
af 0*9? z*dadt < Cet"? J 0*0 Z2 dadt. (9.124) 
Q Qo 


Noting that 


























3T/A 
af 025 22 drdt > E Ji [ee z?dadt 
Q T/A 


3T/4 
|» (92 3 2 
> min (0 (T/4, x) (T/2,2))E fh Jr dxdt 














and that 


























f 0*9? dzdt < max (e(t) (62) J z dxdt, 
0 (t,3)eQ Qo 


recalling (E.EN) and 0 = ef, we deduce that (124) implies that 


3T/A 
jd | 2 dadt 
G 


max (0°(t,2)y%(t,2)) 
gue ues E f 2dxdt (9.125) 
min (erj4, x)y3(T/2, 2) Qo 









































< Cet“? J z? dedt. 
Qo 


By Corollary LA, the inequality (E.T23) implies the desired estimate (93). 
This completes the proof of Theorem E-Z3. LI 
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9.6 Null and Approximate Controllability of Stochastic 
Parabolic Equations 


In this section, based on [B15], we deal with the null and approximate con- 
trollability for (ZG). First of all, we have the following result. 


Theorem 9.36. Under the condition (Œ), the system (GH) is null control- 
lable at any time T. 


In order to prove Theorem E.38, in view of Theorem LIA, we need the 
following observability result for (ECTU) (Recall (ELT3) for Kı): 


Theorem 9.37. Under the condition (ŒA), all solutions (z,Z) € L}(Q; 
C([0, T]; L?(G;R™))) x L2(0, T; L?(G;R™)) to the system (ELTU) satisfy that 


|z(0) za. (Q:L2(G;Rm)) 


~2 
< CE (Ixao z [rator tom) + 1Z11200,7;12(G:R™)))> (9.126) 


V zr € L}, (2; L?(G;R™)). 
Remark 9.38. In Theorem E34, we assume that a1; € Lg*(0,T;W v (G; 


R”*™)) for j = 1,2,--- ,n (See the condition (EL7)). It seems that this as- 
sumption can be weakened as a1; € LẸ (0, T; L°(G;R™*™)). 


The rest of this section is mainly devoted to giving a proof of Theorem 
E37. For simplicity, we consider only the case m = 1. 


9.6.1 Global Carleman Estimate for Backward Stochastic 
Parabolic Equations 


As a key preliminary to prove Theorem E34, in this subsection we establish 
a global Carleman estimate for the following backward stochastic parabolic 
equation: 


dz 4- V (az, ),, dt = fdt + ZaW(t) in Q, 
j k-1 


z=0 on X, 
z(T) = zr in G. 


(9.127) 


In the rest of this section, similar to that in Section BS, we choose 0 and 
£ as that in (E.SH), and v» given by Lemma with G, being any fixed 
nonempty open subset of G such that Gi C Go. The desired global Carleman 
estimate for (ELTZ7l) is stated as follows: 
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Theorem 9.39. There is a constant uo = uo(G, Go, (aff)nxn, T) > 0 such 
that for all u > uo, one can find two constants C = C(u) > 0 and Ag = Ao(u) > 
0 such that for all X > Ao, f € L&O, T; L?(G)) and zr € L3 (Q; L'(G)), the 
solution (z, Z) € [L2(2; C((0, T]; L?(G))) n L2(0, T; Hd (G))] x L2 2(0, T; L?(G)) 
to (2127) satisfies that 


























xyts | 0253 22 dydt + A? J 0?o|V 2|?dadt 
Q Q 






































«e(t E / 0355 2dadt +E f 8? f?drdt + X pE | 0*2 Z?dzdt). 
Q Q 
: (9.128) 


Proof: The proof is similar to that of Theorem E.30. We shall use Theorem 
EZI with b/^ and h replaced respectively by —a/* and z (and hence w = 0z). 

Integrating the equality (79) (with b" replaced by —a/*) on G, taking 
mean value in both sides, and noting (EL92), we conclude that 
































2E [LX [X (at! Wr; Nag tAv] [az + y» (area) ,d| dz 
=1 j,k=1 
n 
—2E Í 5 (aj wa, dw), da 
J k=l 
+2E [bs 35 (2a k Ls Wa; Wap, —ai*gi * Lats, Way) 


Q j k= 1 LX 1 


—V al w, w + al ( 








Ti 


E )v?] , leat (9.129) 














> 282E h [POW IVE? + AOH) Vw? + p? (Aute + AO) 


+20 (ue tlc) + AO (e?! lec) u? | dxdt 














n 
2 
+2 af | 5 Caen + Au) dxdt 
Q jk-1l 


























+E f 6? 5 al^ (dzz, + £, dz)(dz;, + lx,dz)dz — E f 0? A(dz)? da 
Q Q 


j,k=1 
where 
n n 
A= 5 (afla len — ad by, +a? lrer) — his y = -2 > ds 
j,k=1 j,k=1 


By (ELIZ2), it follows that 
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af | i (a)* Wr; ate Jay + Aw] [az + » (af za, Jay dt] da 


j,k-1 j,k=1 





v 











n 


f e| (atwa, Jor + Au] (fdt + ZAW (t))dz 
Q 


j,k-1 





Il 
Ww 





(9.130) 
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efo |- 5 al we, Jer + Aw] fatdz 


j,k=1 


f| S aj* Us, Jap Au] dtdx + E sf @ Patan, 
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j,k=1 








| À 
































It is clear that the term “F f 6? 5 aj" (dza; + lr dz)(dzz, + lx,dz)dx” 
j,k=1 
in (@129) is nonnegative. Hence, by (ELTZJ)- (E.L30), similarly to the proof of 
(TUT), one can show that 














2588 | [POPIT 3000) Vu + p? (evo! x00) 


439 (uid etlo) + AQ (een)? dxdt (9.131) 














< af 6? (f? + AZ?) dxdt. 
Q 


Similarly to (2104), from (E.T31]), we conclude that there is a uo > 0 such 
that for all u > uo, one can find a constant Ao = Ao(4) so that for any A > Ao, 
it holds that 











we | 0? p(|V2|? + Mu? v? 2?) dzdt 
Q 

















< ce | 9*2 + X3 uh e? Z?ydadt (9.132) 
^ JQ 














T 
TA? J I e^ p(|Vvzp? + Xy? z^ asd]. 
0 JG 


Choose a cut-off function ¢ € Cg? (Go; [0, 1]) so that ¢ = 1 in G4. Proceeding 
as in (105), from (QIZA), we obtain that 
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n 
0= f 8? Iz (o. + 2Xgn) + 209 5 AEA 
Qo j,k=1 
n 
T2uC o(1 + 2rp)z »» a! ds War 


j,k=1 





+4Cpz 5 a as Cek +2 fz + C pZ? |dadt. 
j,k=1 


Therefore, for any £ > 0, one has 
J eo 5 af" zy Zs dadt + J 0?! oZ? dxdt 
° jid d (9.133) 
- C 
< eF f 0C o|V z| dxdt + - Le ce zf? t+ Xy e dadt. 
0 


Since the matrix (aJ* )1<i,j<n is uniformly positive definite, we conclude from 


(133) that 








NO 


























Xj 
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T 
J 1 0?o| V z|?dzdt < e 0? (sa; sf? +282?) dadt. (9.134) 
0 Gi 


Combining (TIZA) and (134), we obtain (@128). This completes the 
proof of Theorem B39. oO 


9.6.2 Proof of the Observability Estimate for Backward Stochastic 
Parabolic Equations 


We are now in a position to prove Theorem E.37, which is the key observability 
estimate for the backward stochastic parabolic equation (10). 


Proof of Theorem D-7]: Applying Theorem E39 to the equation (10), 
recalling (ZTA) the definition of Kı, we deduce T for all u > uo and à > 
Ao(u s 


à’ u4 f 023 z?dzdt + Ap? J 9?o|V z| dxdt 
Q Q 


















































zex E ji 9353 2 drdt + X? pE | 9*5? Z2dedt 
0 Q 


Efe Dx (0132), — (a2 — a3a4)2 — asz] dodi) (9.135) 


j=1 


< clu! af 0*9? zz dadt + 2 J 8? (IVz]? + 7p? p72? + Z?)dzdt 
0 Q 






































4M af 85? Z7dedt] 
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Choosing u = uo and A = C(1 + #7), from (134), we obtain that 


E f 0? z? dxdt 
Q 


«ces | 0*3 | zl dadt + J £e? |Z Pasa). 
Qo Q 














(9.136) 


























Recalling (LXX), it follows from (E-T3G) that 


37/4 
E f z?dzdt 
T/A JG 














max (eq. r) (t, x) + 0? (t, xo? (t, 2) 


2 (5,2)eQ 
(92 3 
min (e (T/4, x)o (T/2,2)) 


«(s f jel dvdr + f |Z?dædt) (9.137) 
Qo Q 


«eet (s f |z|?dadt + f |Z|?dzdt). 
Qo Q 


By (ELTZ) in Proposition BA, it follows that 


< Cel" 













































































J z?(0)dz < e^ af 2 (tdr, | Vtc[0,T]. (9.138) 
G G 


Finally, combining (E.T37) and (138), we conclude that, the solution 
(z, Z) to the equation (B.IU) satisfies (Z12G). This completes the proof of 
Theorem ELT. LI 


By modifying a little the proof of Theorem E.37, we can prove easily the 
following result (hence we omit the proof): 


Proposition 9.40. Under the condition (Œ), any solution (z, Z) € L2(Q; 
C([0, T]; L2(G; R"))) x L2(0, T; L?(G; R")) to the system (ELTU) vanishes i- 
dentically provided that z = 0 in Qo and Z — 0 in Q, a.s. 


Remark 9.41. Since Z = 0 in Q, a.s., the system (E.IU) becomes a (back- 
ward) random parabolic equation. Hence Proposition £40 follows also from 
the known observability estimate for deterministic parabolic equations (e.g. 


A). 


By Theorem LIY and Proposition £40, one obtains immediately the fol- 
lowing approximate controllability result for (Z0): 


Corollary 9.42. Under the condition (B0), the system (EG) is approximately 
controllable at any time T. 
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9.7 Notes and Comments 


There are numerous studies on the controllability theory of deterministic 
parabolic equations (See A, ILI 54, [I9T, B36] and the references cited 
therein). Generally speaking, most of these results are based on either the 
global Carleman estimate introduced in [IT7] or the time iteration method 
introduced in [IJI]. Each method has advantages. In this chapter, we employ 
both of them to study the null controllability of stochastic parabolic equa- 
tions. In order to establish the key global Carleman estimates for stochastic 
parabolic equations (or even other stochastic partial differential equations), 
so far there exist two ways in the literatures: 


e The first way is that introduced in [B15], which is based on a pointwise 
weighted identity for the stochastic parabolic-like operator, i.e., the iden- 
tity (A) in Theorem EZA. 

e The second way is that introduced in [218], which uses surprisingly a known 
global Carleman estimate (See Corollary (32) for a random parabolic 
equation (which may follow from the existing results for deterministic 
parabolic equations) and a careful duality argument. 


Each of the above two ways has its own merits. Indeed, each of them may need 
different conditions for different equations (See for example [ZT8, 222, B15] for 
more details). 

By virtue of some counterexamples in Section ai (from [ZT9]), it is found 
that the controllability of the coupled system (EL58) is not robust w.r.t. the 
coupling coefficient in the diffusion terms. Indeed, when this coefficient equals 
to zero on the whole time interval [0, T], the system is null controllable (See 
Theorem ELTS). However, if it is a nonzero bounded function, no matter how 
small this function is, the corresponding system is uncontrollable any more. 
Hence, the Carleman-type estimates cannot be used to study the control- 
lability of (E:58)). Notice that in [890] a similar phenomenon was found in 
studying the unique continuation for the characteristic Cauchy problem of 
(deterministic) linearized Benjamin-Bona-Mahony equations. In fact, the u- 
niqueness of this equation depends strongly on the zero sets of its potentials. 
Hence, the desired unique continuation results in [B90] were proved by means 
of spectral analysis and the eigenvector expansion of the solution rather than 
the Carleman-type estimates. Similarly, the controllability of the stochastic 
coupled system (5X) was proved also by the spectral method. 

One can find some other interesting works related to controllability, ob- 
servability, unique continuation, stabilization, Hardy's uncertainty princi- 
ple, insensitizing controls and so on for stochastic parabolic equations, say 
[LT 12, 64, 94, 142, IT95, (96, 215, 237, B58, B59, B60, BGT, B62, B65, BST]. 

There are some other interesting techniques to prove the controllability of 
deterministic parabolic equations, which should be extended to the stochastic 
setting, for example: 


9.7 Notes and Comments 329 


In [93], the null controllability of the heat equation in one space dimension 
was obtained by solving a moment problem, based on the classical result on 
the linear independence of a suitably chosen families of real exponentials in 
L?(0, T). This method was generalized to obtain the controllability result 
for the heat equations in multi-dimensions (e.g., [/]). However, it seems 
that itis very hard to employ the same idea to prove the null controllability 
of stochastic partial differential equations. Indeed, so far it is unclear that 
how to reduce the latter stochastic null controllability problem to a suitable 
moment problem. For example, let us consider the following equation 


dy(t, x) — Yaa (t, x)dt 

= f(x)u(t)dt + a(x)y(t,2)dW(t) | in (0, T] x (0,1), 
y(t,0) = y(t,1) 20 on (0, T), 
y(0, x) = Yo(2) in (0, 1). 


Here yo € L?(0,1), a € L*(0,1), f € L?(0,1), y is the state variable and 
u € L£(0,T) is the control variable. One can see that it is not easy to 
reduce the null controllability problem for the system (139) to the usual 
moment problem (but, under some conditions it is still possible to reduce 
it to a stochastic moment problem, which remains to be done). 

In [293], it was shown that if the wave equation is exactly controllable for 
some T > 0 with controls supported in some subdomain G of G, then 
the heat equation is null controllable for all T' > 0 with controls supported 
in Go. This result is not sharp when applied to the heat equation with 
smooth coefficients, since geometric restrictions are needed on the subset 
Go where the control applies. It seems that one can follow this idea to 
establish a connection between the null controllability of stochastic heat 
equations and stochastic wave equations. Nevertheless, at this moment the 
null controllability of stochastic wave equations is still open, which seems 
even more difficult than that of stochastic heat equations. 

In this chapter, we assume that the principle part coefficients a/^ € 
W?9e(G). This assumption can be weaken. Indeed, one can easily see 
that the Carleman estimate approach works for Lipschitz continuous coef- 
ficients. Nevertheless, at this moment, we do not know what the minimal 
regularity condition is for the coefficients a/^. A first controllability re- 
sult for deterministic parabolic equations with piecewise constant principle 
part coefficients (by means of Carleman inequalities) has been established 
in [78] but imposing some monotonicity conditions for these coefficients 
at the interfaces. In [I89], based on some modification of the tools from 
pseudo-differential operators, it has been proved that these monotonicity 
conditions can be dropped for the scalar coefficients. It seems that one 
can follow their methods to study the Carleman and observability esti- 
mates for stochastic parabolic equations with discontinuous principle part 
coefficients but this remains to be done. 


(9.139) 
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'There are many other unsolved problems related to the topic of this chap- 
ter. Here, we mention only two of them. One is to prove the null control- 
lability of (2G) with only one control, i.e., v = 0, for which we have ex- 
plained the difficulty before. Another one is the null and approximate con- 
trollability for stochastic semi-linear parabolic equations. For deterministic 
semi-linear parabolic equation, people employ the Carleman estimate and 
some fixed point theorems to derive the null and approximate controllability 
(e.g., a, 95, 117). Since at this moment it is unclear whether these fixed 
point theorems can be generalized to the stochastic setting, we do not know 
how to use a similar method to solve the null and approximate controllability 
problems for stochastic semi-linear parabolic equations. 


| 
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Exact Controllability for a Refined Stochastic 
Wave Equation 


In this chapter, we shall prove that the usual stochastic wave equation, i.e., 
the classic wave equation perturbed by a term of Itó's integral, is not exactly 
controllable even if the controls are effective everywhere in both drift and diffu- 
sion terms, which means that some key feature is ignored in this model. Then, 
by means of a global Carleman estimate, we establish the exact controllability 
of a refined stochastic wave equation with three controls. Moreover, we give a 
result about the lack of exact controllability, which shows that the action of 
three controls is necessary. Our analysis indicates that, at least from the view 
point of Control Theory, the new stochastic wave equation introduced in our 
work is more reasonable than the one in the existing literature. 


10.1 Formulation of the Problem 


Similarly to parabolic equations, hyperbolic equations (and its special case, 
ie., the wave equations) are another class of most typical partial differential 
equations. In the deterministic setting, the controllability theory for hyper- 
bolic equations are also extensively studied. Hence, people hope to know what 
will happen for its stochastic counterpart. As we will see in this chapter, so 
far the stochastic situation is far from satisfactory. 

For T > 0, n € N, a bounded domain G C R" with a C? boundary I, 
a nonempty subset Ig of I and a nonempty open subset Go of G, satisfying 
suitable assumptions to be given later, write 


Q-(,T)xG, 2=(7)xF, 
Mo = (0, T) x Io, Qo = (0, T) x Go. 


In the rest of this chapter, we assume (a?*)1<j,4<n € C?(G; R"*") satisfy 
that aJ* = a (j,k = 1,2,--- ,n) and for some constant so > 0, 
£ A 
XO alee’ > solé, V2, £) Elx, é, E) eG xR”. 
j,k=1 
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We begin with the following controlled (deterministic) wave equation: 


T. 
Ut — b» (al! Yo; a, = «1: Vy +azy in Q, 
k=1 
á (10.1) 
y = XD h on X, 


y(0 = yo, (0) =y in G. 


Here (yo, y1) € L?(G) x H^!(G), a1 € L**(0, T; W^? (G; R”)), a2 € L®(Q), 
(y, yz) is the state variable, and h € L?(Xo) is the control variable. It is well- 
known that (e.g., [209]), the system (IOT) admits one and only one transpo- 
sition solution y € C([0, T]; L2(G)) n C (0, T]; H -! (G)). 

Controllability (and also observability) for deterministic wave equations 
are now well-understood. Indeed, it is known that (e.g., [L4 RU, LO, 207, BAN, 
Bg6]), under some assumptions on (T, G, To) and the coefficients (a/*)1—; i, 
a; and az (for example, for the case that (a/^)12; ,—,, is the n x n identity 
matrix, a; = 0, a3 = 0, Io = (x € I | (x — zo) - v(x) > 0) for some xo € R”, 
and T > 2max,cg|x — zo|), the system (MLI) is exactly controllable, i.e., 
for any given (yo, y1), (zo, 21) € L?(G) x H^ 1(G), one can find a control ^ € 
L?(X) such that the solution to (LLI) satisfying y(T) = zo and w(T) = 21. 

The main goal of this chapter is to study what happens when (OT) is 
replaced by stochastic models. We shall see that, the corresponding stochastic 
controllability problems are much less understood. 

As before, (2,7,F,P) (with F £F eto) is a fixed filtered proba- 
bility space, on which a one dimensional standard Brownian motion W(-) 
is defined, and F is the corresponding natural filtration. We denote by IF 
the progressive o-field w.r.t. F. Also, in the sequel we fix some stochastic 
coefficients a; € Lg? (0, T; W?9(G; R")), a2,a3,a4 € Lg*(0,T; L'*(G)) and 
as € Lg? (0, T; Wo? (G)). 

First, let us consider the following controlled stochastic wave equation: 








TL 


dy: — y» (ays, ),, dt = (a1- Vy + azy + f)dt 


j,k=1 
-F(aay + g)dW (t) in Q, (10.2) 
y=Xzh on X, 
y(0)=yo, y(0)= y in G, 


where the initial datum (yo, y1) € L? (G) x H ^! (G), (y, y+) is the state variable, 
and f,g € Lg? (0, T; H^! (G)) and h € L2(0, T; L?(I)) are three controls. As 
we shall see in Section [IU.2, the equation ([[U2) admits one and only one trans- 
position solution y € Ce([0, T]; £7(Q; L?(G)))n Cà ([0, T]; L2(2; H ^1 (G))). In 
some sense, (MLZ) looks quite natural because it is the classic (controlled) wave 
equation perturbed by a term of Itó's integral. 

We introduce the following notion of exact controllability for (2). 
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Definition 10.1. The system (IUA) is called exactly controllable at time 
T if for any (yo,y1) € L?(G) x H^! (G) and (yy) € LE, (9: L?(G)) x 
L2. (Q;H~*(G)), one can find a triple of controls (f, g, h) € L2(0,T; H~1(G)) 
xL2(0, T; H~'(G)) x L2(0, T; L?(I9)) such that the corresponding solution y 
to (WIZ) satisfies that (T) (T) = (vb, ¥4). 


Since three controls are introduced in ([IU.2), one may guess that the de- 
sired exact controllability should be trivially correct. Surprisingly, as we shall 
show below that, the exact controllability of (I2) fails for any T > 0 and 
Io CI, even if the controls f and g are acted everywhere on the domain G. 


Theorem 10.2. The system (ITZ) is not exactly controllable for any T > 0 
and Ig C I. 


Proof: We use the contradiction argument. Choose v € Hj(G) satisfy- 
ing |v|rz(g) = 1 and let go = £v, where € is the random variable given in 
Proposition EZ. Assume that (12) was exactly controllable for some T > 0 
and Ib C I’. Then, for any yo € L?(G), we would find a triple of controls 
(f,g,h) € L2(0,T; H^! (G)) x L2(0, T; H^ (G)) x L2(0, T; L?(Ip)) such that 
the solution y € Cp([0, T]; L?(2; L?(G))) n CECO, T]; L? (2; H^! (G))) to the 
equation ([IU.2) satisfies that y(T) = o. Clearly, 


T 
J itar- | wvas= f (yt, V) n1 (8), 83 (ca) dt, 
G G 0 


which leads to 
T 
e= | wot | (yt, V) n (8), ni (ca) dt. 
0 


This contradicts Proposition EZ. Oo 


Note that, the above controls are the strongest possible ones that peo- 
ple can introduce into (IQA). Obviously, this differs significantly from the 
well-known controllability property (mentioned before) for deterministic wave 
equations. 

Motivated by the above negative controllability result for (12), similarly 
to (6.26), in what follows, we consider the following refined version of con- 
trolled stochastic wave equation: 


dy = jdt + (aay + f)dW(t) in Q, 
dj — 5 (a7 "Yn; )ary dt = (a1: Vy + azy + asg)dt 
jk-l 
(10.3) 
+(asy + g)dW (t) in Q, 
y —Xxh on X, 


y(0)— yo, §(0) = ĝo in G. 
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Here (yo, ĝo) € L?(G) x H-!(G), (y,) is the state variable, and f € 
L£(0,T; L?(G)), g € L2(0, T; H1 (G)) and h € L2(0, T; L?(Ip)) are three con- 
trols. As we shall see in Section LLZ, the equation (LLA) admits one and only 
one transposition solution (y, 9) € Cg([0, T]; L7(Q; L2(G))) x Cp((0, T]; L? (02; 
H~*(G))). 

Remark 10.3. We put two controls f and g in the diffusion terms of (73). 
The first equation in this system can be regarded as a family of stochastic 
differential equations with a parameter x € G; while the second one is a 
stochastic partial differential equation. Usually, if we put a control in the 
diffusion term, it may affect the drift term in one way or another. Here we 
assume that the effect is linear and in the form of “asgdt” as that in the 
second equation of (IA). One may consider more general cases, say, to add a 
term like “aş fdt” (in which ag € LẸ (0, T; L (G))) into the first equation of 
(3). However, the corresponding controllability problem (as the one studied 
in this chapter) is still unsolved. 


The exact controllability for (IZA) is defined as follows: 


Definition 10.4. The system (ITA) is called exactly controllable at time 
T if for any (yo,o) € L^(G) x H7'(G) and (y1,q1) € LE, (0; L?(G)) x 
L*. (Q; H-(G)), one can find a triple of controls (f, g, h) € L2(0, T; L?(G)) x 
L£(0,T; H1 (G)) x L2(0, T; L?(To)) such that the corresponding solution (y, à) 
to ([U.3) satisfies that (y(T), 9(T)) = (y1, 91). 

In this chapter, under some assumptions, we shall show that (M73) is 
exactly controllable (See Theorem LLIA). Hence, from the viewpoint of con- 
trollability theory, the system (IZA) is a more reasonable model than (2). 
Noting that, we also introduce three controls into ([[[L3), which seems too 
many. However, we prove that none of these three controls can be ignored; 


moreover both f and g (the two internal controls) have to be effective every- 
where in the domain G (See Theorem M9). 


10.2 Well-Posedness of Stochastic Wave Equations With 
Boundary Controls 


In order to define solutions to both (I2) and (ITA) in the sense of transpo- 
sition, we need to introduce the following backward stochastic wave equation: 
dz = dt + (bsz + Z)aW (t) in Q,, 


TL 


d£ — 5 (a" za, )«, dt 


jk-1 


Z n (10.4) 
= (bı Vz + b2z + b3Z + b4Z)dt + ZAW (t) in Qr, 





z=0 on Xz, 


z(r) 2z', 2r) = in G, 
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where 7 € (0, T], Q, $(0,7) x G, X, 2(0,7) x T, (27,27) e L3- (2; HUG) x 
L?(G)), b € Lg? (0, 7; W^? (G; R")), b; € LE (0, T; L'*(G)) (i = 2,3,4) and 
bs € Eo (T Ww, (G)). 

By Theorem ÆI, for any (27,27) € L}, (2; H3(G)) x LE (02; L?(G)), the 


equation (MLA) admits a unique mild solution (z, 2, Z, Z ). Moreover, 
l21cs(0,7:22(8) + |2lee((o,7;12(@)) + |Z] 22(0,7;42(@)) + 1ZIr2(0,7;12(6)) 


Ceo (I^ l2. (o: co) F l2" |r2. (0:120); 
(10.5) 
where 
4 


A 
r= [blige ow anny +> lilie orra + Pol oa ey 
F a F F (0,7; 0 (G)) 
i= 


Let us recall the following known result (See [2U7, p. 29] for its proof). 


Proposition 10.5. There exists a vector field € = (€1,--- ,£") € C1 (IR^; R”) 
such that £ =v on I. 


The following regularity result for solutions to (ILA) will be needed later. 
Proposition 10.6. Let (27,27) € L} (0; Hi (G)) x LZ (0; L?(G)). Then the 


(mild) solution (z,2, Z, Z) to (WA) satisfies 82 |. € L2(0,7; L?(I)). Further- 
more, 


Oz 
Ov 


where the constant C is independent of T. 





Cr T OT 
ates < Ce" (I^ lzz. (oxi coy + lle rea) (10.6) 


Proof: For any nÊ(nt, um) € CHR, x R^; R”), by Itó's formula and 
the first equation of (Z4), we have 


d(2n-Vz) = dên- Vz + Zq - Vzdt + ĉn- Vdz + dên- Vdz 
= din: Vz + Zu - Vzdt + ên- V (£dt + (bsz + Z)dW(t)) 
+d2n-Vdz 





1 
= din: Vz + im: Vedt + 5 [div (22n) — (div n)2?] dt 
+ên- V(bsz + Z)dW (t) + dên - Vaz. 


It follows from a direct computation that 


n 


3 (2(n : Vz) eo — nf S Cts) 


k=1 j=l i,j—1 k 


n n 


n 
= 2] ` (a as oen Vz + b» md — M Zn, Za, div (a) ^r). 


jk-l ijk-1 jk-1l 
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Hence, 


n n 

[x (n- Vz) es 2; +7 (2 — 5 a 25,2,,) ] dt 

k=1 ij=l Vk 
n 


= 2|- d(2n-Vz)+ (a2 — > (a2, dt)n -Vz + Zn : Vzdt 
j,k=1 (10.7) 


TL TL 
— 5 CENE ET — (div n)2?dt + p» Zn; Zn, div (a) "dt 
ijk-l jk-l 


+2dên - Vdz + 22n V(bsz + Z)dW (t). 


Let £ € C! (R"; R”) be given in Proposition ILA. Setting n = € in (D, 
integrating it in Q, and taking expectation on 2, we obtain that 


— J Y (n: Vz) es +h (2 —- » aH 2,,2,,) |v*drat 
ij=l 


Xr k=1 






































£ -æ | eee, 2(0)n - Vz(0)dax 
G G 


ej (bs -Vz -F baz +b3Z + b4Z)n- Vz + £m Vz (10.8) 


T 


TL TL 
- 5 a za, Zarna; — (div n)? + 5 Zz, Zn, div (aj n) 


i,j,k=1 j,k=1 
42Zn- V(bsz + Z) dxdt. 


Noting that z = 0 on (0, 7) x I^, we have 


ef Sf (n: voles ~ - Y attzgsz,) | vharet 












































Xr k=1 n=l 
= JA o(a) P» dd al^ y^y Bo avt yig* vi Ee [ Jarat 
= jd »» alk evil 2 arar > so af Pra (10.9) 
T j k-1 T 


It follows from the estimate (M14) that 
|The right hand side of (IIIL)| < Ce”! (lz" lza. (9H (e) + [27 | za. . (2s 12(G)))« 


This, together with (IZA) and (9), yields the desired estimate (IH). This 
complete the proof of Proposition IA. L1 
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Remark 10.7. Proposition [IU.G shows that, solutions to (LLA) enjoy a better 
regularity on the boundary than the one provided by the classical trace theo- 
rem on Sobolev spaces. Such kind of results are called hidden regularities (for 
solutions to the equations under consideration). There are many studies on 
this topic for deterministic partial differential equations (e.g. [2U8]). 


Systems (I2) and (IZA) are nonhomogeneous boundary value problems. 
Their solutions are understood in the sense of transposition solution intro- 
duced in Section LA. 

In view of Definition LO, a stochastic process y € Cg([0, T]; L?(2; 
L? (GY) ACEO, T]; L2(2; H^ (G))) is called a transposition solution to (12) 
if for any T € (0, T] and (27,27) € L- (2; Hå (G)) x L (2; L^(G)), it holds 
that 























E(yi(T), Z')u-(G),Hi(G) — E(v(7), 27) rta) 





E H-1(q),H1(a) + (Yo, 2(0)) r2 (6) 


— " " ne ars, 
To 


where (z, ê, Z, Z) solves (IA) with 






































bı = —a1, b2 = —divaı +a2, b3=a3, b4=0, b5=0. 


Likewise, a pair of stochastic processes (y, d) € Cr([0, T]; L?(2; L?(G))) x 
:«([0, T]; L2(0; H-!(G))) is called a transposition solution to (ITA) if for 
ny T € (0, T] and (27,27) € LE (Q; Ha(G)) x LE (2; L*(G)), it holds that 


Q 


a 


























E(Q(T). 2") w-1(@),H3(@) — EG); 27) 2a) 





— (ĝo, z(0)) #-1(a@),H1(a@) + (Yo, 2(0)) z2 (a) 


= -e f (f, 2)rz(a)dt + ef (9, Z) H-1(6) Hia) at — f [5 h5- dr ds, 
0 


(10.11) 






































where (z,2, Z, Z) solves (Z) with 


bı =—a1, b2 =—diva, +az2—a3a5, 3 -— as, b4-— —a4, bs = —as. 


Note that, by Proposition ILE, the solution (2,2, Z, Z) to (MIA) satisfies 
zl € L2(0,7; L?(I)), hence the term “E A Sr nz dI ds" in both (IU) 
and (O) makes sense. 

By Theorem LIJ, one can easily deduce the following well-posedness re- 


sults for (12) and (13): 
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Proposition 10.8. 1) For each (yo,y1) € L?(G) x H^1(G) and (f,g,h) € 
L£(0,T; H-!(G)) x L2(0,T; H-1(G)) x L2(0,T; L?(I9)), the equation (TZ 
admits a unique transposition solution y € Cg([0, T]; L? (2; L?(G)))n C$ ([0, T]; 
L?(Q; H-!(G))). Furthermore, 


IV lcs.) z2(9:z2(6))nc2 Qo.T]; 12 (0:8 1 (6))) 
< Ce"? (lyo|r2qay + lila) + |flez(o.rs#-1(G)) 
+|9|12(0,7;4-1(@)) + |Alz2(¢0,7;22(1)))- 


Here 
3 


T3 — la: lg: (o, wt (iR) + 5 la2 [1.2 (o, 1 (6) 
k-2 
2) For each (yo, ĝo) € L?(G) x H^ !(G) and (f. g, h) € L2(0, T; L?(G)) x 
L2(0,T; H-1(G)) x L2(0, T; L? (To)), the equation (ITA) admits one and only 
one transposition solution (y, 0) € Cr([0, T]; L2(2; L?(G))) x Ce([0, T]; L? (02; 
H~1(G))). Moreover, 


(v; Dow qo;T) 12 (9:12 (6) x es (o. TI £2 (9:517 (9) 
< Ce"? (Wolrz(ay + lol nr (6) + || rz(o,rz2(8)) (10.12) 
-Helrz(o rir: (9y + |h] ra (o, 12 (0) 


Here 
4 


A, 2 
r2 = [ailte (or wi (gn)) + p» leslie (o, (6) (10.13) 
k=2 : 


2 
*laslr 2 (or wi (oy 


10.3 Main Controllability Results 


We have introduced three controls (f, g and h) in the system (ŒA). At a 
first glance, it seems this is unreasonable, especially for that the controls f 
and g in the diffusion term of (IZA) are acted on the whole domain G. One 
may ask whether localized controls are enough or the boundary control can be 
dropped. However, the answer is ^no". More precisely, we have the following 
negative controllability result for the system (3). 


Theorem 10.9. For any open subset Io of I' and open subset Go of G, the 
system (ITA) is not exactly controllable at any time T > 0, provided that one 
of the following three conditions is satisfied: 

1) a4 € Ce([0, T]; L* (G)), GN Go z 0 and f is supported in Go; 

2) as € Ce([0, T]; L?*(G)), GN Go z 0 and g is supported in Go; 

3) h=0. 
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Proof: Let us employ the contradiction argument, and divide the proof 
into three cases. 


Case 1) a4 € Cr([0, T]; L°(G)) and f is supported in Go. Since Go C 
G is an open subset and G \ Go Z 0, we can find p € C$? (G \ Go) satisfying 
lelz2(e) = 1. 

Assume that (1123) was exactly controllable. Then, for (yo, ĝo) = (0,0), 
one could find controls (f,g,h) € L2(0,T;L?(G)) x L2(0,T; H !(G)) x 
L£(0,T; L?(Io)) with supp f C Go, ae. (t,w) € (0, T) x 2 such that the 
corresponding solution to (IZA) fulfills (y(T), 9(T)) = (p£,0), where £ is giv- 
en in Proposition EZ. Thus, 


T T 
pee l dt + f OE (10.14) 


Multiplying both sides of (ILIA) by p and integrating it in G, we obtain that 


T T 
el scho dt | (aay, p) r2 (a) dW (t). (10.15) 


Since the pair (y, j) € Cp([0, T]; L2(Q; L?(G))) x Ce([0, T]; L2(2; H ^1 (G))) 
solves (L3), then (9, p) m-1(c),ma(a) € Cw([0. T]; L?(2)) and (aay, p) rsqa) 
€ Cp((0, T]; L2 (2)), which, together with (LLIS), contradicts Proposition EZ. 

Case 2) a3 € Cr([0, T]; L^ (G)) and g is supported in Go. Choose p 
as in Case 1). If (IIU-3) was exactly controllable, then, for (yo, fo) = (0,0), 
one could find controls (f,g,h) € L2(0,T;L?(G)) x L2(0,T; H ! (G)) x 
L£(0,T; L?(Io)) with suppg C Go, ae. (t,w) € (0, T) x 2 such that the 
corresponding solution to (13) fulfills (y(T), 9(T)) = (0, £). 

It is clear that (4, Jj») = (py, pi) solves the following equation: 


do = ódt + (as + pf)dW (t) in Q, 


dó — X` (aps, ),, dt = Cdt + asódW(t) in Q, 


j k-1 
(10.16) 
o=0 on X, 
d =0 on X, 
é(0) —0, (0) =0 in G, 


where ¢ = > [(a7* pr; y), + al^, Px,| + pai: Vy + pa2y. Further, we have 
jk-l 

(T) = 0 and G(T) = p£. Noting that (¢,¢) is the weak solution to (11), 

we see that 
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(p£, P) H-2(6),H2(6) 


q n . 
= / K 5 (afpa; ),,, B E + CP carne dt 


jk-1l 


T 
+f (aad, P) ray W (t), 


which implies that 


(a)* 
g= [K (a asd P) aaoo * aea | 
j, 


2 à (10.17) 


+f (a3, P)r gy W (t). 


Since (9, 6) € Cg([0, T]; L2(Q; L?(G))) x Ce([0, T]; L2(.2; H^! (G))), then 


jk 2 
(3 a $;) Tk? a E + (C: P} n1), (c) € Lg(0, T) 


and (a39, p) rc) € Cr([0, T]; L? (42)). These, together with (LLTI), contradict 
Proposition BZ. 

Case 3) h = 0. Assume that the system (LLA) was exactly controllable. 
Then, by Theorem LIA, solutions (z,2, Z, Z) to (14) (with 7 = T) would 
satisfy that, for all (zT, 27) € L3 (2; Hà(G)) x L%, (2; L*(G)), 


(27, £ ra (Q;Hl(G))xL2. (0;L?(G)) 
NT Rid (10.18) 
< C(IZlzato;r nio + |4|220,7;22(6)))- 


For any nonzero (7,731) € Hd(G) x L?(G), let us consider the following ran- 
dom wave equation: 


TL 


Th — 5 (a/^ ny; )o, dt = bi: Vn + bən in (0, T) x G, 


j,k=1 
(10.19) 
z=0 on (0, T) xT, 
(0) = 10, (0)—m in G. 
Clearly, (n, 0, 7,0) solves (LLA) with the final datum (27, 27) = (n(T),7(T)), 
a contradiction to the inequality (IUIN). oO 


Now, similarly to the deterministic setting, in order to give a positive 
controllability result for the system (IZA), we need the following additional 
assumptions on the coefficients (a) 1j ken: 
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Condition 10.1 There erists a positive function q(-) € C?(G) satisfying 


that: 
1) For some constant uo > 0, 


p» D (24 a! io, Ja — ads a! * Poy EF 


k—1 j',k'=1 
nes . (10.20) 
= po b» ad gig. y(x, Et, E") EG xR”. 
jk-l 
2) The function q(-) has no critical point in G, i.e., 
min |Vy(a)| > 0. (10.21) 
LEG 
In the rest of this chapter, we shall choose the set I as follows: 
mê E er | Y. apa (v^ (x) > o}. (10.22) 
j,k=1 


Also, write 


/max y(x Ro / min y(x). 
LEG xEG 


It is easy to check that if y(-) satisfies Condition ILI, then for any given 
constants a > 1 and GER, p= ps + B still satisfies Condition II with po 
replaced by apo. Therefore we may choose y, Ho, Co > 0, c1 > 0 and T such 
that 


Condition 10.2 The following inequalities hold: 


1 ; EM 
) xz Opna) pal) R, Vee: 
jk-1 


2 T»T,22R; 


2R1\2 2R4 : ! 
3) ( T ) < c1 < —- and cı < min 4 1, = = 
T 16(1 + lasls (0,T;L e»? 


and 


4) Ho — 4c, — co > V Ry. 


Remark 10.10. Conditions can be regarded as some modification of 
similar conditions introduced in [153] (See also [ITT, TUJ]). As we have ex- 
plained, since Yea aj, Ya, > 0, and one can choose po in Condition 
I] large enough, Condition could be satisfied obviously. We put it here 
merely to emphasize the relationship among 0 < co < cy < 1, uo and T. In 
other words, once Condition E] is fulfilled, Condition can be always 
satisfied. 
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To be clearer, we give an example for the choice of y when (a/^)12; ,—;, is 
the identity matrix. Let zo € R” \ G such that |x — zo| > 1 for all x € G and 


o = max |x — zo[?. Then for all constant a > max(ao, 1}, 
rEG 


a > Va max |x — zol. 
zeG 


Let p(x) = alx — zo|?. Then the left hand side of (Z0) is specialized as 


2 102555) =2alé?, Vig.) EG xR”. (10.23) 
j=l 


Then, (Z0) holds with po = 2o. Further, it is obvious that (LIZI) is true 
g 


i Sane -iLe0 Y = o?lz — ao? > max g(a). 
jkl rcG 


Hence, the first inequality in Gat conf | holds. Next, one can choose T 
large enough such that the second and third inequalities in Condition 


hold and 1 
ci « min {1, H 
16(1+ las 2» (oT 1 (6^ 





Let o > (00,1, 4c1 + co}. Then uo — 4c — co > V fà. 


Remark 10.11. To ensure that 3) in Condition holds, the larger of the 
number las] Łe (0,T;L=(G)) is given, the smaller of cı and the longer of time 
T we should choose. In some sense, this seems reasonable because a5 stands 
for the effect of the control in the diffusion term to the drift term. One needs 
time to get rid of such an effect. 


Our exact controllability result for the system (ITA) is stated as follows: 


Theorem 10.12. Let Conditions ILI and (ZZ hold, and Ip be given by 
(ZA). Then, the system (LTA) is exactly controllable at time T. 


The proof of Theorem is rather long and technical. Indeed, the main 
body in the rest of this chapter is devoted to proving this theorem. 


Remark 10.13. Although it is necessary to put controls f and g on the whole 
domain, one may suspect that Theorem is trivial. For instance, one may 
give a possible *proof" of Theorem as follows: 

Choosing f = —a4y and g = —aay, then the system (ILJ) becomes 


dj — 5 (6595), di = (a1 -Vy + aay — a5a3y)dt in Q, 
jk-1l (10.24) 
y — Xxyh on X, 


y(0) = yo. H0) = Ho in G. 


10.4 A Reduction of the Exact Controllability Problem 343 


'This is actually a wave equation with random coefficients. If one regards the 
sample point w as a parameter, then for every given w € £2, there is a con- 
trol u(-,-,w) such that the solution to (IILLZ4]) fulfills (y(T, x, w), 9(T,2,w)) = 
(1 (2, w), §1(x,w)). It is easy to see that the control constructed in this way 
belongs to L7. (2; L?(0,T; L?(Ip))). However, we do not know whether it is 
adapted to the filtration IF or not. If it is not, then it means to determine the 
value of the control at present, one needs to use information in future, which 
is meaningless in the stochastic framework chosen in this book. 


10.4 A Reduction of the Exact Controllability Problem 


In this section, we shall reduce the exact controllability problem for the sys- 
tem (123) to the same problem but for the following controlled backward 
stochastic wave equation: 


dy = ydt + (asy + Y)aW (t) in Q, 


dy — 5 (a ^y adt = (ay: Vy + ay + as Y dt 


jk-1 
-H(aay + Y)dW (t) in Q, (10.25) 
y =Xx,h on X, 
y= on X, 
y(T) = y”, y(T) = $7 in G. 


Here (y7, 97) € L} (9; L?(G)) x L}, (02; H^! (G)), (y, y, Y, Y) is the state 
variable and h € L£(0, T; L*(Ip)) is the control variable. Note that there is 
only one control in the system (M125). 

Solutions to (ILZA) are defined in the sense of transposition as well. For 
this, we need to introduce the following equation: 


dz = zdt + (f — asz)dW (t) in Q*, 


da — X` (a*z,,),, dt 





jk-l 
= [-a, - Vz + (diva; + a3 — agas)z + asf — a4f]dt + ÉdW(t) in Q7, 
z=0 on X7, 
aT) =Z,, Ż(T)= 2, in G. 


(10.26) 
Here Q* S(7,T) x G, X* É(s, T) x P, (21,87) € L3. (Q; Hi(G)) x LÈ (02; 
L*(G), f € L2(0,T; Hi(G)) and f € L2(0,T;L?(G)). Note that, un- 
like the backward stochastic wave equation (MLA), the system (MZA) is 
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a forward stochastic wave equation. By means of Theorem BIJ, for any 
(z.,2,) € LÈ (0; HE(G)) x L% (0; L?(G)), f € L2(0,T; Hà(G)) and f € 
L2(0, T; L?(G)), the system (mz) admits a unique weak solution (z,2) € 
Ce([r, T); H1 (G)) x Ce([r. T]; L?(G)). Moreover, 


Izl Tiaa) + llesqerzico) 
< Ce" ([z-|r. (H) + I£«|rz. (a;:02(@)) + Fflzzto. iiio» (10.27) 
+lf|22(,7;12(a))); 
where s 
E lalt (or woe (a) +X lailte (oL (6) 
i-2 
5 
tA lailte (ors e) lal o (or wa ce) 
and the constant C is independent of 7. 
Similar to the proof of Proposition [IU.G, one can show the following result: 


Proposition 10.14. The solution (z,%) to (OLZA) satisfies |r € L2(r. T; 
L?(I)). Furthermore, 


oz 
Ov 





< gota Z;|r2 1 + |Z-| 2 2 
lotum (Iz-lr2. (0:830) + lel. (2:120) (o8) 


-Fflr2(o, rio + I£|r2(o.7:12(6)): 


where the constant C is independent of T. 


m 


In view of Definition [ T3, a quadruple of stochastic processes (y, y, Y, Y) 
€ Cr([0, T]; L?(02; L(G))) x Cr((0, T]; L2(0; H^! (G))) x L2(0, T; L? (G))x 
L£(0,T; H-1(G)) is called a transposition solution to (IZA), if for any 
(z.,2,) € L% (0; H(G)) x L% (Q; L?(G)), f € L2(0,T; Hà(G)) and f € 
L£(0,T; L?(G)), it holds that 

















E($7 z(D)) n (e), e) — Ely” 2(T)) rto 
—E($(T). 24) -1(G),H3(a) + Ety (7): 27) r2(a) 














T T 
= -e | (Y, £) ra(qydt + f (Y. f) a-c), ni (a) dt — E 7H fs hc “dr ds. 
T T Ii 
° — (10.29) 
Here (z, Z) solves (IZZA). Note that, by Proposition [LTA the solution (z, Z) to 
uan satisfies |r € L2(r, T; L?(T)), hence the term “E n tr h2£qI ds" 
n (29) makes sense. 
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By Theorem [Z14, for each (y7, $7) € L3 (0; L?(G)) x L34, (2; H !(G)) 
and h € L2(0, T; L?(Ip)), the system (ZJ) admits a unique transposition 
solution (y, y, Y, Y). Moreover, 


IG. $)lc«qo;rir2(0:12(6))) x C ([0,7];L2 (9; H 1 (G))) 
+|(Y, Yn zz (o, z2(6))x 12 (0,78 (6) (10.30) 
<ce™ (I^ za. (220) =F $7 zz. cor: (9) F Ih[ r2(o.r;z2 (079) 


where rg is given by (IOTA). 

Similarly to that for (cy), the system (125) is called el control- 
lable at time T, if for any (y7, 37) € L*-. (Q; L*(G)) x L3 (2; H~*(G)) and 
(yo, yo) € L?(G) x H-!(G), one can find a control h € L0, T; " (19)) such 
that the corresponding solution (y, $) to (IZZA) satisfies that (y (0), $(0)) — 
(Yo, Yo). 

Clearly, the following two results hold. 

Proposition 10.15. Let 7 =T in (ŒA) and r = 0 in (HLM). If (z, 2, Z, Z) 
is a solution to (ITA), then so is (z,Z) = (z,2) to (L265) with the initial 
data (zo,Zo) = (z(0),2(0)) and the nonhomogeneous terms (f, f) = (Z, 2). 
Conversely, if (z,2) is a solution to (IIU.28), then so is (z, 2, Z, 2) = (z, 2f, f) 
to (ITA) with the final data (27,27) = (z(T), £(T)). 

Proposition 10.16. If (y, j) is a transposition solution to (IA) for some 
f € L2(0,T;L7(G)), g € L2(0,1; H^! (G)) and h € L2(0,T; L? (T 5», then 
so is (y, y, Y, Y) = (y,9,f,9) to (ZA) with the final data (yT, $7) = 
(y(L), 9(L)) and the nonhomogeneous term h = h. Conversely, if (y, y, Y, Y) 
is a transposition solution to (IZA) for some h € L2(0, T; L?(Ip)), then so 
is (y, 9) = (y. y) to (LU.3) with the initial data (yo, ĝo) = (y(0), $(0)) and the 
nonhomogeneous terms (f, g, h) = (Y, Y, h). 

By Propositions [LIJ and (1116, and by borrowing some idea from [275], 
we obtain the following result: 
Proposition 10.17. The system (ŒA) is exactly controllable at time T if 
and only if so is the system (25). 

Nc The “if”? part. Let (yo, ĝo) € L?(G) x H-!(G) and (yT, $7) € 

(025 L?(G)) x Lz.. (2; H^! (G)) be arbitrarily given. Since (ILZA) is exactly 

ON at time T, there exists h € L2(0, T; L?(Ip)) such that the cor- 
responding solution (y, $, Y, Y) of (ZA) with (yT, ýT) = (yT, 97) satisfies 
that (y(0), ¥(0)) = (yo, Jo). Hence, (y, 9) = (y, y) is a solution to (I3) with 
a triple of controls (f,g,h) = (Y, Y,h) such that (y(T),9(T)) = (y™,9*). 
Hence, the system (ILA) is exactly controllable at time T. 

The proof for the “only if" part is similar. L1 

By Proposition LTZ, the exact controllability of (3) is reduced to that 
of (ZJ), which is easier to be handled, and therefore in the rest of this 
chapter we shall focus on the later. 
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10.5 A Fundamental Identity for Stochastic 
Hyperbolic-Like Operators 


As a key preliminary to prove the exact controllability of (ZƏ), in this 
section we shall derive a fundamental identity for stochastic hyperbolic-like 
operator, which has some independent interest and may be applied in other 
places. 
Throughout this section, we assume that b/^ € C?((0, T) x R”) satisfies 
bik = bti for j,k = 1,2,--- ,n, and £, V € C?((0, T) x R”). Write 
p 2 (bi* £,), + > (P oan — DPF Er) qr wer, 
j'k'—l 
A j ae 
AEG — bit) — M (Wla bay, — (050...) - v, (10.31) 
jk-1l 


TL 


BE AW + (AG) — V (Ad Cs, Joy + +5 (te - 3 qu): 


j,k=1 j,k=1 

Very similarly to the identities (L49), (RT) and (225), we have the fol- 
lowing result. 
Lemma 10.18. Let z be an H? (R”)-valued Itó process and 2 be an L?(R")- 
valued Itô process so that 

dz = ĉdt + ZAW (t) in (0,T) x R” (10.32) 

for some Z € L2(0, T; H! (R")). Set 0 = ef, v = 0z and ô = 02 + (qv. Then, 
for ae. x € R”, 


n 


e( - 265-2 Y: VL. vs, d) (as - x (0*2... dt) 


jk-1 jk-l 
; : jkpj'k' jkpj'k' 
+ | YI QUI be vey tep — VFO Ls Yay} 
jk-l _j',k'=1 


36b 5v,, + bla 0? Vb us o — HR! — Ab C, v?| — (10.33) 


Tk 





«|t, p» Vv, Vay + hô? 2 5 OF la vs 6 — Wve + (Atia a? 


j,k=1 j,k=1 
= Iz + = (Ola ae v) 6? + pya gu Uny + Bu? 
j,k=1 j,k=1 


25 (e*t, er uve (- 26642 Y UL, v. v) Jat 


j,k=1 j,k=1 
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T, n 

t4 (d6)? —2 5 V^, dus  dó—Wdvdó +4, X b^ (dvs; )(dvs,) 

j,k=1 j,k=1 


«AL, (dv)? — [o( — 2640 4-2 5 bF e, Un, + Wu) QZ 


j,k=1 





-(2 »» b (0Z),, ls, 0—00 + awiz) 
j,k=1 


+2( 5 bitve, (8Z)a, +OAVZ) L| dW(t), a.s., 


j,k=1 


where (dv)? and (dô)? denote the quadratic variation processes of v and 6, 
respectively. 


Proof: By (13), and recalling v = 0z and 6 = 02 + (4v, we obtain that 


dv = d(0z) = 6zdt + 0dz = (,0zdt + 02dt + ÓZdW (t) = ôdt + 0ZdW (t). 








(10.34) 
Hence, 
d£ = d[0 (6 = Liw] = 0^ [do Fa vdt lidu £A4(0 ,v) dt] 
(10.35) 
= 07! dà — (260 + luv — Gu)dt — 0&,ZaW (i). 
Similarly, by bj* = b*J for j,k = 1,2,--- ,n, we have 
pee es (10.36) 
j,k=1 
=0 V [(b*v,,),, — 20/54, Vap + (la lon — bI le, — blajar )0]. 
j,k=1 


Therefore, from (35)-(L30) and the definition of A in (130), we obtain 
that 


TL 


e( - 260 2 5 bbs vs, V) (d$ — YO (W ze;)endt) 


jk=1 jk=1 


= ( — 266 +2 » LT Vay + vv) [do = x (b7* ve, Ja, dt + Audt 
jk-l jk-l 


+( - 2602 Y V5, vu, + vu) dt — oe Zaw (t)| (10.37) 
j,k=1 


- (72662 Y] 9G os, + ro) di (72602 D> 0*6 ve + Po) dt 
j,k=1 j,k=1 





348 10 Exact Controllability for a Refined Stochastic Wave Equation 
n n 
+( — 26,6 4- 2 * ALPEN + vu) ( = 5 (bF vs ex + Av) dt 
jk-1 jk-1 


-e( - 260-42 Y] Vou + v)u ZdW (t). 
j k=} 


We now analyze the first and third terms in the right-hand side of (M137). 
Using Itó's formula and noting (IIU.34), we have 


(26642 Y] blave, +¥v) dé 
j,k=1 


-d(- 49 +2 »» b/*0, vs 0 + Iob) — 2 $3 DKL, ódv,, — Wedv 


jk jk-l 


-( — £u? 2 Y (b) vs o + wô) dt + (dô)? 





j,k=1 
=2 » bl, dvs, dó — V dvd (10.38) 
j,k=1 
= a( - tô? +2 p» bla, Vap 0 + Yd ae?) d BU"). di 
jk-l j,k=1 
+[(eu+ » (954, )., — v)e -2 p» (b 5, ) 0,6 la dt 
j,k=1 j,k=1 





+6,(d0)? — 2 M5 V0, dv; dó — Wdvdó 
j,k=1 


= (2 Y. 0^(02),, 0,0 — ODZ + 0VoZ) dW (t). 
j,k=1 


Next, 


-2%ô( — : (bv, a, + Av) at 


j,k=1 


3 


n n 
=2 V (b"us 0), dt — 2 V^ Gu bi v, dt — 26, V^ ^v, On, dt 
j,k=1 j,k=1 j,k=1 


—2Abvôdt (10.39) 


(Libius 0),, dt— 2Y 4, v5, 0dt— 26, S v ( (dv—0ZdW (t))., 
1 j,k-1 j,k-1 


iL 
i M: 
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—2Af,v(dv—0ZdW (t)) 


=2 Y (Lib vs 8), dt— 2 55 Lau, b) v, üdt— a(t 5 bE Ug Ury Atv?) 


j k-l j,k=1 j,k=1 
+ M (G0) v, vs, dt + (AG) v? dt +4 XO b (dvz;) (duss) 
j,k=1 j,k=1 





AL (dv)? + 2( Y. bi vn, (8Z)ox + &AvZ) &dW (t). 
jk-1l 
Further, by some direct computation, one may check that 
2 » bE la, va — 5 (b os as + Av) 
j,k=1 j,k=1 


TL 


== b» | x (2 2 * g lz; syn OO by vus) ADSL, v? 


j k-1 9! k’=1 es 
tM (26 (bla, Joy, — (^b t), usus, (10.40) 
j,k,j',k'=1 
= 5 (ADIF la Jant’ 
j,k=1 
and 
vv( - RA (b)* Di) Jax Av) 
j,k=1 
a jk Wars jk 2 jk 
=— (vv Ug,U — E U ) +Y 5 b Va; Ury (10.41) 
jk-l "y jk-1l 
Ls s 
+( -3 2059.) + Av) v? 
j,k-1 
Finally, combining (II0.37])- (II.4T]), we obtain the desired equality (133). 
This completes the proof of Lemma OTA. Oo 


10.6 Observability Estimate for the Stochastic Wave 
Equation 


In order to prove Theorem OIA, by Proposition IATA and Theorem LZA, 
it suffices to establish the following observability estimate for the stochastic 
wave equation (26). 
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Theorem 10.19. Under the assumptions of Theorem ILTA, all solutions to 
the equation (IIULZ8) with T — 0, f = 0 and f = 0 satisfy that 








Oz 
5 «C Cra 
|(20, 20) la (@)x12(@) as Ov L2(0,T;L2(To)) (10.42) 
V (Zo, Zo) € Hi(G) x L? (G). 
Proof : The proof is split into three steps. 


Step 1. For each parameter A > 0, let us choose 


L(t, z) = Ay) —06 (t — 2)] ; (10.43) 


where y(-) and cı are given in Conditions IO] and IOAZ, respectively. Put 





A T HS . 
ASÍ t, | (t ) as! \, for i=0,1,2. (10.44 
(t,x) €Q | v(a)-— cı 3]? 20-3) or i =0 (10.44) 
Let T T 
n5 -aT, qu adr 


"2 i for i — 0,1, (10.45) 
Qi AT, T;) x G, 
where £g and £; are given below. 
From Condition and (10043), it follows that 


cT? 
4 





£(0,x) = &(T, x) < (m = ) <0, WaeeG. 10.46) 


Hence, there exists e; € (0,4) such that 
Ag C Qi 10.47) 


and that 





L(t, x) < 0, V (t,x) € ((0, T1) U (Ti, T)) x G. 10.48) 
Next, since {T/2} x G C Ao, one can find £o € (0,61) such that 


Qo C Ao. (10.49) 


Step 2. Recall Condition for co. For each (zo, 29) € HA(G) x L?(G), 
let us apply Lemma with (OD i<j ies = (a) 12; ken and 


V = lu + M (ala; )ar — Cor (10.50) 
j,k=1 


to the corresponding solution (z, 2) € Ce([0, T]; H4(G)) x Cr([0, T]; L? (G)) to 
(126) with 7 = 0, f = 0 and f = 0, and then analyze the resulting terms 
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in (1133) one by one. In what follows, we use the notations v = 6z and 
0 = 02 + Liw, where 0 = ef for l given by (23). 

Let us consider first the terms which stand for the “energy” of the solu- 
tions. To this end, we need to compute the orders of À (when A is sufficiently 
large) in the coefficients of 67, |Vv|? and v?. 

Clearly, the term for 6? reads 


(t D (a/^£, .),, — v)e = cA. (10.51) 


j,k-1 
Noting that ltz, = £,;,4 = 0, we get 
2 Y ((a?*la,)t + a) le, ) v«,6 = 0. (10.52) 
j,k=1 


From (50), we see that 


TL 
(aE) + Y Qu" (aly), — (1s), ) t 
jk 
T, 
= a) d, 4 5 (2a7*' (a). - (affa? ta), E 
ITa k k 
S pn * 
-Fai* (tu + 5 (a? & bass) my = coà) 
j'k'- 


n 
jk jk' (dj! k jk |j'k jk 
= 2a)" by + J (2a? (a? Us); — aj, a! 1] — aj^cgA 
jhkÀA 


T 
d jk ilk ik ‘kl 
= 2a?" blu +A 1 (2a! (a? Quy); aja! Pay) 
j',k'—1 


nm 
ik! j'k jk 
+A > 2a?” a? Prp Pap — 0 CoA. 
ji 


This, together with Condition I, implies that 


n 
jk 
> C Ug Us, 


j,k=1 
=>), K ("l)e +E (397 (al las nip g (ara by, Jays) + 
jk-1l j',k'=1 (10.53) 
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Now we compute the coefficients of v?. By (IIl), it is easy to obtain that 


n 


A= g m £u 5 (ala ler imi rM PN =W 
j,k=1 
(10.54) 


=) [er -T]y- 5 apr; Par + Ac1À + cod. 
jk-l 


By the definition of B in (3I), we see that 


” " lx i 
B = AW + (AG) — P a 2. (Vs — (aTa, )a,) 


= 2A, = ACoA == 5 alj Ap + Athi 


j,k=1 


[x x ate is 
se 5 5 [a (a " lap ecw lary 


jk-1j'k'-1 





= 203] 2c3 (2t — T)? x38 p» a, ps, — X er (t= T)? (10.55) 
j,k=1 


n n n 
3 jk 3 jk j'k' 
+ Co ) a? (Pr; Pk +À 1 1 a? Px; (a? Pa; Pays are 
j,k=1 j,k=1 j',k'=1 


—4Xed (2t — T)? + O(A?) 


TL TL TL 
= (dey c9)? XO af o, pu, tA MT M ai o, (a7 Yap Coy or 
jk-l j,k=1 j',k'=1 


—(8c3 + coc?) A? (2t — T)? + O(A?). 


n n 
Now we estimate 5 5 al* yy, (a? oi Pry on: From Condition I, 


jk-1j'k'-1 
we have 
n 
jk 
Ho X a" Px; Par 
jk-l 
T. 
jk’ j'k jk jk 
< X (2a (a Peji) — 05,,0 zy Cz; Paer 
j,k-1 j',k'=1 


M= 


Tk! 


iM: iMs 


jk’ jk jk’ jk jk jk’ 
(2a a Pay + 2a a Pa yp m azy az Qj, 


Ex 
ll 


j,k-1j'k'—1 


10.6 Observability Estimate for the Stochastic Wave Equation 353 


T. n 
= 5 p» (2 297" al. Pajp Pu; Pap + 2a) a! "oue Prj y (10.56) 
T il 
-alk af id ay Px; Par) 
n Lu "s " 
=>) > (a : aj, o ji Pa; Pap t adhi E (P2 yay Paj Pay, 
j,k—1 j',k'—1 
tatal eas. clas: Pay) 
n n . . 
= > 5 al" o, (a? k Pr; Pay ler 
j,k=1 j',k'=1 
From (55), (50) and Condition IL, we arrive at 
n nm . 
B > M(4ei oo) M a o, pz, +A Uo XO al p, os, 
j,k=1 j,k=1 
(10.57) 


— (8c + Segct JA? (2t — T)? + O(A? 
1 1 


n 
> (uo + 4c1 + co)? 5 al^ o, Puy — 8c? (4c14 c(t 
j,k=1 





JF OOB). 


Since the diffusion term in the second equation of ([IU.28) (with 7 = 0, 
f = 0 and f = 0) is zero, it follows that 





(10.58) 

















E(G(d6)) 20, E| M7 ala dvs,dô | =0, E(Wdud6) = 




















j,k=1 


From (M143) and noting that dv = 0£,zdt + 0dz = 0(£,z + z)dt — asvdW (t), 


we see that, for some constant Co > 0, 


























E | 4 5 a! (dv, ,(dvs, ) 
jk-1l 
= -2X(t- SE (( ad k (agv);, andis) (10.59) 


j,k 





> -aTAE | + lasl?) ee, + Colo’). 
j k-1 











Next, from (Z3) and (54A), we find that 
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E [At (dv)?] 











= —Xa(t - T) lar -Ty- 5 a pa; pas E ([as|?v?) (10.60) 
Jhai 


—(4e1 + co)c1 (2t — T)E(|a5|?v"). 


From (53), (57), (59) and (60), and noting the fourth inequality in 
Condition [IU.2, we conclude that there is cp > 0 such that for all (t, z) € Ag, 








e| 3 cv, vy, + Bv? +h 3 aj (dv, (dv, ) + At (dv)? 


j,k=1 j,k=1 


TL 
= EA [no 4c1 — co — aT (14 las[*)] p» al y, Va, 
j,k=1 


























n 
. T\2 
(uo + 4er + e)! Y ape paslo]? — 8461 e) (£— 7.) lvl? 
jk-1 


T cu 
aX (t- 5 las? Y ao, uy ol? — At- T) las ol? 
j,k-1 
+0(X)|u/?} 
> E[c2A| Vv? + cod* |v? + O(A?)|o|7]. 


Thus, there exist 4; > 0 and c3 > 0 such that for all A > A, and for every 
(t, x) € A», 














TL 


e( cv, v, + Bo? +4 XO ai (dv, (dv) + At (dv?) 
k=1 jk-1 (10.61) 














J 





> E(c3A| Vv]? + eA? |up?). 











Step 3. For the boundary terms, by v| s = 0, we have the following equal- 
ity: 
TL TL 
E Nc 5 (au a dodo — af a! F lo v, Vay YAS 
XE 


jk j',k'=1 


T nm 
n jk j'k' jk j'k' k 
= rE | > J (2a a? Pay Ur; Vays — aa? ast Vay V dM 
X 


jk-1j'k'-1 























(10.62) 
2 n : ZA Ov .Qu 1 - sit Ov 1 OU D 
Er k_j'k k k j'k k 
=Œ 3. 2, (20 C fus au ce 9 Pa Bue Jae 


j,k=1j',k'=1 


-x f ( Y aftvivt) ( s a! Fo, VF) a az. 


j,k=1 j'k'-—1 
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For any 7 € (0, T1) and 7’ € (Ti, T), put 
Q7 4(7,7') xG. (10.63 


Integrating (I3) in Q7. , taking expectation and by (50), (152), (LIES: 
and (61), we obtain that 


J (6( - 2662 2o vs, + Po) (d 2$ oa, Ja, dt)dz 
T i=1 


— 


) 












































j,k=1 
n py 1 ðv 2 
EN Gk y Jy jk kp 
Bf (Y etn S) $a ga, V )|z7| ax 
j,k=1 j'.k'—1 
+ J dle 5 ad y, Ury 440? —2 p» aly Urp — Vv 
T j,k=1 j,k=1 
V. 
suele 






































> cor J o-drdt +E jf »» ci* Ux Uy, da dt + E Bv? dzdt 
T PRET Q7 


TL 


j jd (4 A a?* (dv, ,)(dv;, ) + At (dv) de 


j,k=1 


J ( 20,6 -- 2 ` af £, Ury v) dad. 
Q 


j,k=1 


























(10.64) 
Clearly, 


n n 
J dle X aj o, Ua, 440? —2 5 a" £, v, LO — Vv 


j;k-1 j,k=1 














«(At + 2)! dx 


= TO Us, (T )uz, (7^) + &ó( N22 af Es vs. (T )O(T') 


























j,k=1 j,k=1 
—Wv(r')o(7’) + (At t — da (10.65) 
— JJ [e 2 al v, (T) T)us, (T) + 49(7)? — 2 5 aj* Estas (T)O(T) 
j,k-1 


-wv(ry(r) + (At + - dz 
<C? Ji [(6(7)? + |Vv(r)? + v(7)?) + (6(77? + |Vv(r)? + v(7)?)] da. 
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By 0 = ef and (1148), there is a Ay > 0 such that for any A > A1, 
A30(T) € 1, A30(7^) < 1. (10.66) 


Since v = 6z and 6 = 02, it follows from (56) that 








XE J [(8(r)? + [Vo(r)P? + v(7)?) + (00)? + Vor)? + v(7')?) ae 


<e f 
G 


From (24), (1047) and (053), we obtain that A3 C Q7. Thus, 


AE f ô?dzdt = XE f (02 + L02)” dxdt 
QF Ms QF Ma 

















[(z(7)? + |Va(r)|? + z(7)?) + (a(7/)? + |V2(r")|? + z(7)?)] dz. 





















































































































































(10.68) 
< 2AE f 6°27 dadt + 2°E f (2t — T?0?z? dxdt 
Qz'Ma Qz'Ma 
and 
E c^, vs, dzdt = af c^ (02x, )(OZx, dxdt 
LN 2 : Q7’ \A2 2 , 
= af 5 (Ave, + Za) Per + Zz, )dzdt (10.69) 
Qz'M2 j,k=1 
<C J 0?|Vz|?dxdt -- CX? af 0? |z|?dadt. 
Q7'\A2 Qr'\A2 
Furthermore, it follows from (58) that 
E 1 Bu’ dxdt < CXE a 0?z? ddt. (10.70) 
Q7 M2 Q7 \M2 
Next, by (0259) and (150), we obtain that 
f E b» a" (dv, ,) (dus, ) + At (dv? dx 
uod hel (10.71) 








z] 




















< cxx f 0?|Vz|?dzdt + CX? f 0? z^ dxdt. 
Qz'MA2 Qz'Ma 


From (LA), we deduce that 0 < exp(AeRor/ 8) in QT V 42. Consequently, 
there exists Ap > max(Ao, M] such that for all A > A2, 


CA max 6? < e0/3 CX max 6? < e*F0/3, (10.72) 


(a,t)€Qz’\ As (a,t)€eQt'\ Az 
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It follows from (G1) and (IIX.GS)-(IIU.72) that 















































dB | ô? dadt + E jf 3 ci* Vr; Uy, dz dt + E Bv? dxdt 
sa Q7 j,k=1 Q7 
4E f (u 37 a (dvs, (dos, ) + At (vd (10.73) 
F j,k=1 














> 























> J dadi + caXE | IvoPdzdt + dE f lvl da dt 
Ap A2 A2 

















—eòP0/3 f (Iz? + |Vz|?) dade. 
Q 


Noting that (z, Z) solves the equation (128) with 7 = 0, f = 0 and f = 0, 
we deduce that 


J 6( — 260 29 ala, os, + ro) (d -5 ( (af ms „dt)dz 
A i=1 


j,k-1 
R > 
- J 6( — 266 2 ala, os, + Uv) 
Q7 i=1 


T 


























x|- a -Vz + ( — diva; + ag — a3a5)2|dadt 


J e( — 26,6 + DIOLA + We) dadt 


i=1 





IA 


























+12 J (|Vz|? + z?)dadt. 


(10.74) 
Combing (1764), (057), TA) and (M74), we conclude that there exists 
Aa > max(As, Crs + 1} such that for any À > As, 


























Fj 6? (|a? + |Vz|?)dzdt + e 0? |z|?dadt 
Ay 


1 


olay 
V 





< e[s f (Iz? + |Vz|? + |z|?) dxdt + orie f 
Q Xo 

















+e f (2(7)? + |Va(r)|? + 2(7)? + 2(7')* 4 IVz(r f + 2(7")?) de]. 
G 

(10.75) 
Integrating (LZA) with respect to 7 and 7' on [75, T1] and [T1, T3], respec- 
tively, we get that 
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ef 67 (|2|? + |Vz|?)dzdt + J 0? |z| dxdt 
Ai 


1 















































< ce^Ro/3 f (I|? + |Vz|?)dzdt + ce^Fe/ J |z|?dadt (10.76) 
Q Q 
Se Oz |? 5 22 2 1.22 
4CeMüg | dX + CE (2 T|Vz[*-z )dxdt. 
x, OV Q 








From (W144), we find that 














J e^ (ap + |Vzl2 + zP)dadt 
Ai 














> J 67 (2|? + |Vz|? + |z|?)dadt (10.77) 
Ao 














> eM? J (Iz|? + |Vz|? + |z|?)dzdt. 
Qo 


Combing (T) and (7%), we arrive at 














J (I2]? + | Vz|? + |z|?) dxdt 
0 


























< Clara? J (IZ? + |Vz|? + |z|?)dadt + N2e>FG/6 af |z|?dadt 
Q Q 


























Jor e LEM ge f (a? + |Vzf + z?)azdt]. 
Xo Q 


(10.78) 
Applying the standard energy method to the equation (ILZA) with 7 = 0, 
f — 0 and f — 0, we obtain that 














|(20, 20) Iri (e) «z2(e) € CE f, (lal? + |Vz|? --|z^)drdt (10.79) 
0 


and that 














l(zo. 20) Fr aya (o) 2 C6 af (lg? + |Vz|? + |z?) dzdt. ^ (10.80) 
Now, by (IIXL73)-(I0.80), we end up with 


|(z0, 20) 71a (c) 2 (6) 
Oz 


2 (10.81) 
—| dX 
o 0V 














-AB2 H AR? 
< Cere Fo/9 (20, 20) 2r) rata) TCeMR n 





Let us choose A4 > A3 such that CeCrse—&R6/6 < 1, Then, from (787) with 
À > A4, we obtain the desired inequality (ILZA) immediately. This completes 
the proof of Theorem [II TU. LI 


10.7 Notes and Comments 359 


10.7 Notes and Comments 


'There are numerous studies on the controllability and observability of deter- 
ministic hyperbolic equations (e.g., [[7, IA, 6:3, 80, 88, LU, 23, (146, 153, 165, 
1199, 207, 295, B89, B95, H9G] and the references cited therein). 

Generally speaking, one can find the following five main methods to solve 
the exact controllability/observability problem of deterministic wave equa- 
tions: 


e The first one is the method of characteristic line ([I99, 295]). This method 
only applies to wave equations in one space dimension. 

e The second one is based on the Ingham type inequality (|I, 295]). This 
method works well for many partial differential equations involved in some 
special domains, i.e., intervals and rectangles. However, it seems that it is 
very hard to be applied to equations in general domains. 

e The third one is the classical Rellich-type multiplier approach (|2U7]). Usu- 
ally, it is used to treat several partial differential equations with time in- 
dependent lower order terms. 

e The forth one is the microlocal analysis approach ([I4]). It is useful to 
solve controllability problems for many kinds of partial differential equa- 
tions such as wave equations, Schrödinger equations and plate equations. 
Further, it can give sharp sufficient conditions for the exact controllability 
of wave equations. However, there exist lots of difficulties if one expects to 
adopt this approach to study stochastic control problems. 

e The last one is the global Carleman estimate ([B84]). This approach has 
the advantage of being more flexible and allowing to address variable co- 
efficients. Further, it is robust with respect to the lower order terms and 
can be used to obtain explicit bounds on observability constants/control 
costs in terms of the involved coefficients. 


So far, among the above mentioned five methods, only the one of global 
Carleman estimate was successfully extended to studying the controllabili- 
ty/observability problem of stochastic wave equations ([09, 224, 227, Z:1N, 
247, B86]). This chapter is based on our recent work [247]. 

There are many open problems related to the topic of this chapter. We shall 
list below some of them which, in our opinion, are particularly interesting: 


1) Null and approximate controllability for stochastic wave equa- 
tions. In Theorem ILIZ, the exact controllability for (LLA) is presented. As 
an immediate consequence, we obtain the null and approximate controllabili- 
ty for the same system. Nevertheless, in order to show this later result, there 
seems no reason to introduce three controls. By Theorem [IU.J, it is shown 
that only one control applied in the diffusion term is not enough. However, 
it seems that one boundary control is enough for the null and approximate 
controllability for both (2) and (03). Unfortunately, some essential dif- 
ficulties appear when we try to prove such a result, following the method 
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to prove Theorem [IU.T2. For example, for the null controllability, we should 
prove the following inequality for solutions to (ILLA) with 7 = T: 


Oz |? 
2 5 2 
lice) + Olina «c f. [| aras 
V (27,27) € L}, (0; HA(G) x P? (G)). 


However, if we utilize the method developed in this chapter, we only obtain 
that, for all (27, 27) € L2- (0; Hà (G) x I? (G)), 


Iz (0) [5 (ey + [2 Z2(6) 


<c| f Paras [ iz «f i dt 
Se prag y liga + f, |4lzaceydt | - 


There are two additional terms containing Z and Z in the right hand side of 
the above inequality. These terms come from the fact that, in the Carleman 
estimate, we regard Z and Z simply as nonhomogeneous terms rather than 
part of solutions. Therefore, we believe that one should introduce some new 
technique, for example, a Carleman estimate in which the fact that Z and 
Z are part of solutions is essentially used, to get rid of the additional terms 
containing Z and Z. However, we do not know how to do it at this moment. 





2) Exact controllability for stochastic wave equations with sharp 
conditions. In Theorem ILIA, we obtain the exact controllability of (3) 
for I given by (LZA). It is well known that a sharp sufficient condition for 
exact controllability of deterministic wave equations with time-invariant coef- 
ficients is that the triple (G, I9, T) satisfies the Geometric Control Condition 
introduced in [I4]. It would be quite interesting and challenging to extend this 
result to the stochastic setting, and it seems that there are lots of things to 
be done before solving this problem. Indeed, the propagation of singularities 
for stochastic partial differential equations, at least, for stochastic hyperbolic 
equations, should be established. However, as far as we know, this topic is 
completely open. 


3) Exact controllability for stochastic wave equations with more 
regular controls. In Theorem LIA, we show the exact controllability of 
(3) by a triple of controls (f, g, h), where g € L2(0, T; H~1(G)), which is 
very irregular. It is very interesting to see whether (IIU-3) is exactly controllable 
with the control g € L2(0, T; L?(G)). By the standard duality argument, one 
can show that this is equivalent to the following observability estimate: 


T 2T 
l(z ,2 Jua. coni ()x 12 (8) 


sal 





Z . Z . 10.82 
ERTEN + |Zlzzto,riz2(e) + | Igorzaen) ; ( ) 


V (27,27) € Le, (3; Ho (G) x L(G), 
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where (z, 2, Z, Z) is the solution to (IIA) with 7r = T. By Lemma ILIA, simi- 
larly to the proof of Theorem LIY, one can prove that the inequality (LL82) 
holds if the term |Z|r2(o,r;r2(a)) is replaced by |Z|12(0,r;43(@))- However, at 
this moment we do not know whether (LX) itself is true or not. 


f 


Check for 
updates 





11 





Exact Controllability for Stochastic 
Schródinger Equations 


'This chapter is devoted to showing the exact controllability for stochastic 
Schrödinger equations by means of two controls, in which one is a boundary 
control and the other is an internal control acting everywhere in the diffusion 
term. Based on the duality argument, we solve this controllability problem 
by employing the global Carleman estimate to derive a suitable observability 
estimate for the dual equation. 


11.1 Formulation of the Problem and the Main Result 


In the previous three chapters, we studied the controllability /observability for 
stochastic transport, heat and wave equations. Another typical equation for 
which the controllability problems are extensively studied in the determinis- 
tic setting is the Schródinger equation. It is notable that many properties of 
the Schródinger equation are between that of the heat and the wave equa- 
tions. In this chapter, we shall analyze the exact controllability for stochastic 
Schródinger equations. 

Let T > 0, n € N, G C R” be a given bounded domain with a C? boundary 
I. Fix any zp € R” VG and put 


Io S (z € P | (x — zo): v(x) > 0), ani 
QÊO,T) xG, XÊ0,T) xT, SSG rx: 


To begin with, let us recall the controllability problem for (deterministic) 
Schrödinger equation: 


iyi + Ay = a1: Vy + a3y in Q, 


Y = XD U on X, (11.2) 
y(0) = Yo in G, 
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where the initial state yo € H~1(G;C), the control u € L?(X9; C), and the 
coefficients a, (k = 1,2) satisfy a; € L?*(0, T; W>% (G; R?) n Wy’? (G; R”)) 
and ag € L** (0, T; W!** (G; C)). One can show that, for any yo € H^ 1(G;C) 
and u € L?(Xo;C), (ILLZ) admits one and only one (transposition) solution 
y(-) e C((0, T]; H^1(G; C)). The system (ILEZ) is called exactly controllable 
at time T if for any given yo,y1 € H~+(G;C), one can find a control u € 
L? (Xo; C) such that the corresponding solution y(-) to (2) satisfies y(T) = 
yi. 

Controllability /observability problems for deterministic Schródinger equa- 
tion are extensively studied (e.g., M, B5, IS, IT9, ÆI, H2, 87, IT9U, 252, 260, 
280, 289, BIA, H94]). It is well-known that under some assumptions on the 
controller I (for example, I is given in (IILI)) and the coefficients a, and 
ag, the system (ILJ) is exactly controllable at time T. 

The main goal of this chapter is to study what happens when (LL) is 
replaced by a stochastic model. Compared to the deterministic setting, there 
exist only very few results (in [224 228, 229]) on the corresponding control- 
lability problems for the stochastic Schrödinger equations. 

As in the previous three chapters, let (2,7,F,P) (with F 2{Fi}1e(0,7)) 
be a filtered probability space on which a one dimensional Brownian motion 
{W (t) heto,r] is defined, and F be the natural filtration generated by W(-). 
Denote by FF the progressive o-field (in [0, T] x 2) w.r.t. F. Let us consider 
the following controlled stochastic Schródinger equation: 


idy 4- Aydt — (ay - Vy + a2y + a4) dt + (azy + v)dW (t) in Q, 
Xy =u on X, (11.3) 
y(0) = yo in G. 


Here, yo € H~1(G;C), y is the state variable, both u € LÈ(0, T; L? (Io; C)) 
and v € L2(0, T; H ! (G; C)) are the control variables, and the coefficients ag 
(k = 1,2,3,4) satisfy a, € LẸ (0, T; W>% (G; R^) n Wi"? (G; R?)), a2,a3 € 
Lg* (0, T; W'^** (G; C)) and a4 € Lg? (0, T; W^? (G; C)). It is easy to see that 
the control system (LLJ) is a generalization of the system (D.33). As we shall 
see in Section LLA, the system (ILL3) admits one and only one transposition 
solution y € Cp([0, T]; L2(9; H 1 (G; C))). 


Remark 11.1. Similarly to Remark KJ, we introduce two controls into the 
system (LLA). Moreover, the control v acts on the whole domain, and also it 
affects the system through its drift term (in the form a4v). Compared with the 
deterministic Schródinger equation, it seems that we choose too many controls. 
However, similarly to Proposition LC®, one can show that two controls are 
really necessary for our exact controllability problem for (ILL.3) to be defined 
below. 


We now introduce the following notion of exact controllability for (ILL). 
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Definition 11.2. The system (ILJ) is called exactly controllable at time T 
if for any yo € H^! (G;C) and y € L4 (2; H 1 (G; C)), one can find a pair 
of controls (u,v) € L2(0, T; L?(Ip;C)) x L2(0,T; H^! (G;C)) such that the 
corresponding (transposition) solution y to (TA) satisfies that y(T) = yi, 
a.s. 


The main result in this chapter is stated as follows: 


Theorem 11.3. The system (ITA) is exactly controllable at (any given) time 
T > 0. 


One may follow the idea in Section [7:8 of Chapter M (or, more precisely, 
that in Chapter 10 for the exact controllability for stochastic wave equations) 
to prove Theorem in the following two steps: 


1. Reducing the exact controllability problem for the system (ILL) to an- 
other exact controllability problem for a suitable backward stochastic 
Schródinger equation; 

2. Solving the exact controllability problem for the above backward stochas- 
tic Schródinger equation by establishing a suitable observability estimate 
for some forward stochastic Schrédinger equation. 


Nevertheless, in this chapter we do not proceed in this way. Instead, in order to 
prove Theorem [LL3, we shall derive a key observability estimate for a suitable 
backward stochastic Schrödinger equation. This will be done in Theorem LLIA 
by means of the global Carleman estimate. 


11.2 Well-Posedness of the Control System 


The control system (ILJ) is a nonhomogeneous boundary value problem, and 
hence the notions of solutions introduced in Section cannot be applied to it. 
Instead, as in the last chapter, we need to employ the notion of transposition 
solution presented in Section LA. For this, we first introduce the dual equation 
of (ICA). For any 7 € (0, T], let us consider the following backward stochastic 
Schródinger equation: 


idz + Azdt = (bı - Vz + baz + b3Z)dt + ZAW (t) in (0,7) x G, 
z=0 on (0,7) x I, (11.4) 
2(T) = 2, in G, 
where z. € L4 (Q; H9(G; C)), the coefficients b; (j = 1,2,3) satisfy bı € 
Lg» (0, T; Wy’ (G; R")) and bo, b3 € Lg? (0, T; W ^99 (G5 C)). 


Remark 11.4. The regularity of the coefficients can be suitably relaxed. But 
we do not do this because we hope to present the key idea in a simple way. 
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Similarly to the proofs of Theorems EL and ELIU, by means of the usual 
energy estimate and noting that the coefficient b, is R"-valued, it is easy to 
show the following well-posedness result for (LÆ) (and hence we will not 
prove it here). 


Lemma 11.5. For any z, € L% (0; H(G; C) the PUn (LL) admits a 
unique weak solution (z, Z) € L2(0; C([0, 7]; Hà (G; C))) x L2(0, r; Hà (G; C)). 
Moreover, 


lzIrz2tese do. cose») + HZlzato,s na cose € € lel (onac (015) 


where 
d 3 
Ay, a2 42 
Tg [bilis (o rw (iR) + >» Ib [Læ (o, T; Ww 1. (G0) +1. 
j=2 


Next, for the sake of completeness, we give an energy estimate for the 
equation (IA). 


Proposition 11.6. For all solutions to the equation (ITA), it holds that 




















< e Elz(s) etos) + IZ sc sace ): (11.6) 


for anyO<s<t<r. 
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Proof : By Itó's formula, we have 
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mn Ww [21m [div (2V2) - |Vzf* — div (l2|?b1) + (divb)|g] — 17) 
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"HZlis«e)] da 
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E|V z(£)|72(a;c) — ElV z(s)I22(a;c) 
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(v: dVz4 Vz-dVz-4|VZ| do) dex (11.8) 
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A 
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z TEE [28e [ias(Az — i Vz fos — aZ) ] + IVZ }dzdo 


[aiv ( (Vzdz) — Azdz + div (Vidz) — Azdz + IV Zi^dc | dx 














iw 














< 2E T | (sl |b| Wi (GR) + [bs |w.» (a;c) + 1)|VzlZ2(¢.c) 
+(|b2lw1.20(@:c) + loh (eio) + 1)I2l22(o;c) + IZ Baca | do: 


It follows from (LA) and (ILES) that 





























E|z (rri ese) 7 Ellas (e) 
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This, together with Gronwall’s inequality, implies that 
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E|z(t) HGO) S 





i 
«Bg *E f. ZR do): 


which gives the desired inequality (LLG) immediately. The completes the proof 
of Proposition LLA. oO 


Remark 11.7. The proof of Proposition [LL.G is almost standard. Indeed, if we 
regard z (in (ILL4])) as a solution to a forward stochastic Schrödinger equation 
with a nonhomogeneous term Z, then the estimate as (LG) follows from a 
standard energy estimate. Nevertheless, we still give a proof here for exhibiting 
how the constant in (LLE) depends on rı. 


Further, similarly to Proposition in Chapter Bl and Proposition [LA 
in Chapter [IU, we need the following hidden regularity result for solutions to 
(L4) (Note that this sort of regularity result does NOT follow from Trace 
Theorem for Sobolev spaces). 


Proposition 11.8. For any 7 € (0, T] and z, € L} (2; H(G; C)), the u- 
nique weak solution (z, Z) € L2(2; C([0, 7]; Hi (G; C) x L2(0,7; H3(G;C)) 


to (ITA) satisfies a p£ L2(0,7; L?(T;C)). Furthermore, 
v 





Oz 
ðv 





L2(0,7;L2(T;C)) d B " [zz] ra. (9: Hj (G:C))» (11.9) 


where the constant C is independent of T. 
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Proof: Since I' is C?, by Proposition ILJ, one can find a vector field 


h = (h},--- ,h”) € C1 (G; R") such that h = v on I. 
By a direct computation, we obtain that 


TL TL TL TL 
X i X ) ks À > k = 
h Sap KU jh; + h Zap £rjmj 


k=l j=1 k=l j=1 
T TL 
- - (11.10) 
= 2525 [A 25, 22,)o, + (h" zarz; Jey + hz, dz 
k=1 j=1 


—(h* |Z, ee uu 2h; Eus] 


and 


TL 


iV (hz, dz — h" ze, dZ) 
k=1 


[d(h* Zanz) — h'zdz,, — h*¥d%_,dz — (h*2d2)a, 
i (11.11) 


+h* zdz,, + hł zdz] 


Il 


a 
ll 


3 


=i) [d(h^z,,z) — h'dz,, dz — (h*zdz),, + hk, zdz]. 
k=1 


Combining (L0) and (11), we have 
h- Vz(idz + Azdt) + h- Vz(—idz + Azdt) 





=y. [h -V2)Vz + (h- V2)VZ — i(zdz)h — IV z/?A] dt 


n (11.12) 
+d(ih- Vzz) -2 M^ hi z;zydt + (V - h)|V2|?dt 
j,k=1 


+i(V - h)zdz — i(h - Vdz)dz. 





Finally, integrating (LLIA) in (0,7) x G and then taking the expectation in 
the both sides, noting that 














f Lvl |a VZ)Vz + (h- Vz)Vz — i(zdz)h — Ivzpa] dxdt 


-e f. [ [sse * 52s lol lore =e f f sare 


and using Lemma ILJ, we obtain (ILL). Oo 





























With the aid of Lemma [L and Proposition LLN, proceeding as that in 
Definition [ZT3, we may define transposition solutions to (IEA) as follows: 
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Definition 11.9. A process y € Cg([0, T]; L(Q; H^! (G; C))) is called a 
transposition solution to the system (ITA) if for every 7 € [0, T] and z, € 
L*- (Q; Hg (G; C)), it holds that 





3 


H 








(7, +), 2r(+)) n (6,;0,82(8;0) — (Yol), 2(0, )) r1 (6:0), (6:0) 
= ef [5 uc dards + J (v, QAZ + Z) H-1(G;€),H3(G;c)45- 
Io 0 


Here (z, Z) solves (ILM) with 


(y 





(11.13) 


























bi — 01, bg = div a; — 82, b3 = —Q03. 


Now, similarly to the proof of Theorem LIA, one can show the following 
well-posedness result for (IIL3) (hence we omit the proof). 


Proposition 11.10. For each yo € H-!(G;C), the system (I3) admits a 
unique transposition solution y € Cg([0, T]; L?(2; H^ (G; C))). Moreover, 


Cr ([0,7]; L2 (2; H 1 (G5C))) 
|| 


ee (11.14) 
< e"? (Iyo| g-1(G,c) + Iu|r2(o,T;z2(15;0) + lv|r2(o,T;. 1-1 (G:6)))- 
Here 
À 4 
r2 5 |ai[2:«(o,r we (8) +X lakl Les (oT wise (ei) +1 
k—2 


Proceeding exactly as the proof of Theorem CZA, one can show that the 
exact controllability of ([[L3) can be reduced to an observability estimate 
for its dual equation, that is, the equation (LLA) with 7r = T in the present 
case. The main task in the rest of this chapter is to derive such an estimate 
(See the inequality (L50) in Theorem LIAJ), via which the desired exact 
controllability result (for (ILL3)) in Theorem follows. 


11.3 A Fundamental Identity for Stochastic Schrödinger- 
Like Operators 


In this section, we shall establish a fundamental identity for a stochastic 
schródinger-like operator, which is in spirit similarly to the identities (L49), 
(E-IU), (@26) and (MIX). Besides the key role in proving observability esti- 
mates for backward stochastic Schródinger equations, it can also be applied 
in the study of observability and unique continuation problems for forward 
stochastic Schródinger equations. 

Let B(t,z) € C?(R!*"). For j,k = 1,2,--- ,n, let bE (t,x) e C12 (R!*") 
satisfy that 
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p* = pr, (11.15) 
Define a (formal) second order stochastic schrödinger-like operator P as 
PzSiB(tz)dz + Y> (b(t, 2) 205 apt. (11.16) 
j,k=1 


We have the following result: 


Theorem 11.11. Let £, V € C?(R!*"). Assume that u is an H?(R"; C)- 
valued Itó process. Put 0 = e* and v = Ou. Then for a.e. x € R”, it holds 
that 





0(Pul; + Pul) + 4M + divV 


T 
= 2n [^dt + 5 cI} (v. Vep + V2; V2, )at + D|y|?dt 





j,k=1 
+ (3b* pik Ve, V — Vo, V)dt 
p» [ (bt), +0 (BL), (v = vt) (11.17) 
+i] ou + 3 (8/*6,.)..| (Pdv — vdv) 
j,k=1 
+87&,|dv| +i XO Botta, (dvdv., — dvs, d7), as. 
j,k=1 
where x 
lh 2 —iBt,v — 2 5 bi Ver + Wv, 
j,k=1 
AS Y^ baslar Y (We, )ax Y, (11.18) 
j,k=1 j,k=1 
2 plv? 4- iB XO V6 (Van V — vaL), 
jk-1 
vé(y,... Missa yy. 
y^ 3 iV? [bie (vdv — dv) + OF (v, v — v,,v)dt 
j=l 
(11.19) 


-Y V l^ (va, V + Va,v)dt + Y dF (2AC, + Ue,)|v|Pat 
j=1 4-1 


TL 
t SE (2D E Yla (Way Fags + Fey Voy et 


jj^ k'—1 
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and 
A n 
jk jk jk’ jk pg’ k’ jk 
gh y^ EG lossy any BIR’ — (BIR BI bay )ay | -0 V, 
j',k'=1 
(11.20) 


n 


D É(8^4,), + Ss (by, ary + 2] Y (ta, A), + Av). 


jk jk-1 


Proof: The proof is divided into three steps. 
Step 1. By 0 = e and v = ĝu, a straightforward computation shows that: 


Pu = iBdv — iBlivdt + M^ (V v, ), dt + > Dla, ba, vat 


j,k=1 j,k=1 
n M 11.21 
—2 M DMa, vs dt — V (bla, )e Vat EEUU 
j,k=1 j,k=1 
=hdt+ I5, 
where J; is given in (ILLIS), 
I; = idw + M 5 (bva, )e,dt + Avdt. (11.22) 
j,k=1 

Hence, rs u u 

6(Pul, + Puh) = 2|f dt-- (II; + 1515). (11.23) 


Step 2. In this step, we compute Jı T> + I51;. Denote the three terms in 
I, and I; by Ij and I}, j = 1,2,3, respectively. Then, 
na HH 
= —ifav(iBdv) + iBdv(—iB£v) (11.24) 
= —-d(8?L|v)) + (8*4),|v?dt + 8? t|dvp. 





Noting that 





2vdv = d(|v? vdv — vdv dv|?, 
(Iv) — ( ) - dv] (11.25) 


2vVy, = (Iv), — (vva, — VVa,); 


we find first 
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(Bb7* la vdv);, 


e. 
HG 


bo 
c». 
ES 
rM: 


Il 
>. 





(B^. [allv2) — (av — va) — Javi?) } 


Tk 


Il 
Si 


> > 
iM: M> 
(a 


=. 


tans d(|v|?) + 8b" tla, [a(vP)],. — [80ta (vdv — vdv)],. 


S 


— (Bb "la, ) „dv? — BU, dv, dv — BUL, dvdv, l, 





(11.26) 
next 
—2i M (Bb*4,.). vdv 
j,k-1 i 
=-i M (80l), [d(lv|?) — (vdv — vdv) — |dvl? ] 
kel (11.27) 
=i M [(86*4.,), d(lv|?) — (80*6,,).. (vdv — vdv) 
jk-1 
—(6b"*e,,) , |dvf?], 
then 
—2i XO d(Bb* t, vv.) 
j,k=1 
= -i Y df 8t, (vI?)a, — (Wee — VVar )] } 
jk (11.28) 
=i D> { (G0 e,,) (IVP dant + Betea Da] 
j,k=1 
—d[8B6/*0, (vv, — v,)] k 
and 


n 


2i (8*4, .) vv, dt =i M^ a(b la, ) [(Iv|? ex — (vva, — v,)]dt 


jk=1 jk-l 
nm 


= il (8*4...) (|v|?),, dt — (Bla) (vv., — vv, dt]. 
m (11.29) 
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It follows from (ILLZ8)-(ILL29) that 


i) 





+D + BU? 4 


- 





= ( zpY qu Ve, + vv) (iBdv) + iBav( -2 5 TT RES vv) 
j,k=1 j,k=1 


— 2i M Bbl, (v,, dv — v,, dv) + iBU(vdv — vdv) 
k= 


2i | (gui ^£, vdv),. — (Bb*t,.).. vdv — BO la, Vda, 
35 L. 
-2i [a(86, vss) — (Bb/*£, ) vv... dt — po" lo, vds, | 


T 
3e 


J k=l 
+2i V. Bbi*L, dvdv,, + iBl(vdv — vdv) 
j,k-1 
--i Y] guo, (vdv — vds) dti] d| pota, (vy, — vva)] 
jk=1 TR jk-l 
—i 5 (Bb^£. (Vw, — va, )dt +i [ov + 5 (865... (vdv — vdv) 
j,k=1 j,k=1 


+i M bL, (dvdv,, — dva, dv). 


jk-1 
(11.30) 
Noting (LIJ), we have that 
B+ Bi 
= —iBlv V (diva, )ugdt + XO (bv, (ibh) 
j,k=1 j,k=1 
= Y [iow*e(vsy -.v)]. dti SO O (O)u (Pary — Var s)dt. 
jk-l x jk-l 
(11.31) 


Utilizing (ILLIS) again, we find that 
n 
ik ji! k^ = Lad, 

J b? b? £s; [Vas Vastu + Vas ag) 

j,k,j',k'—l 
n 
jkyj' k’ = = 
= > py £s (Viney Voy, + Va ooa Vay) 
j,k,j’,k'=1 


Hence, 
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n 
ik ik! eN " 
2 1 pep E la, (Va Verzi + Vr Vanas dt 
jeg 
TL 
ik! kl = L 
= 1 DIO E la, (Va, Verst + Vins Veras dt 
j,k,j',k'=1 


n 
kis kl » _ 
T X b b £s; (Va ii Vas d Vg gy Vis ) di 
j,k,j',k'—1 








(11.32) 
nm 
= JO ODEL, (Vep Vin Pray) dt 
j,k,j',k'—1l 
m " 
= [ov E ly (Vep Van + Vas Vay) | dt 
jd k'-1 AE 
5 n " 
_ 5 (bik! k bars) sep (Va, Verge + Va, Vary, dt. 
j,k,j',k'=1 
By the equality (II-32), we get that 
B+ RE 
n “nm n “nm 
—-2 X blae, Vax S S (Uv), dt -2 >, (Pv), >, la, vs, dt 
j,k=1 j,k=1 j,k=1 j,k=1 
i " n 
--2 Y [bik E bes (Very Va, + Fay Vi) | dt 
jdghk'-1 Ta’ 
m 
+2 5 p en (va, Vay a Vas )dt 
j,k,j',k'—1 
n . " 
42 p» DFO S (Va, Varzy d Y Varzy )dt 
j,k,j',k'—1l 
n 
= 2 5 [^ii E la, (Vap Vu + Fay Var)] dt 
j,k,j',k'=1 Tk’ 
n * * 
42 M BF (s (Va, Vi, + Ver, Vay) at (11.33) 
j,k,j',k'=1 
i " " 
tM [otv Ela; (Vay Vays + Vas Vas) dt 
je j',k'=1 vh 


TL 


jkyj' k' v 
_ ` (bi b CPM (Vay Vay + Vap Vergy) dt 
j,k,j',k'—1 
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TL 


— 9 5y [bi Oba, (Vay Pay + Vey Vey)| dt 





j,k,j',k'=1 St 
TL 
ik! j'k = - 
42 > DIF (pi bars) ar, (va; Va, + Var; Va, )dt 
jik ji k'=1 
TL 
ikii’ Bel _ - 
+» [v WF a (Vary Vey + Fep Vey )| dt 
j,k,j',k'=1 Se 


n 


- X) (PW ta) g, (vss ea) di 
j,k,j',k'=1 


Further, it holds that 
Hg m 


=w Y ( (bik Va; Ja, dt + Y 0 ers: Jz V vdt 


jk-l j,k=1 
= Y usus vuv) dt— XO Wi*(v, V, + Va; Vay )dt 
jk-l vk jk-1l 
- V, b) (Vep V + Va, v)dt (11.34) 
j,k=1 
=E [Pot (va; + Ve,v)],, dt — > Vb (v, Var + Va; Var, )dt 
jk-l 3,k-1 


= (WPa lvl), dt + V 5 (^v, ),, lvlt. 
j,k=1 j,k=1 
Finally, 
LB + BTI 
= —iBl,v Avdt + Av(—ibliv)dt 


i . (11.35) 
= -2 Y (bla Alv), dt + 2| Y^ (0*6, 4), + AU] |viPat. 
jk-l j,k=1 
Step 3. Combining (ILZ3)-(IIL33), we conclude the desired formula 
(T1). This completes the proof of Theorem LI. Oo 


Remark 11.12. Since we do not assume that the matrix (0/*);—; ,—,, is posi- 
tively definite, similar to [L06] and based on the identity (LLTA) in Theorem 
[LL II, we can deduce observability estimate not only for the backward stochas- 
tic Schródinger equation, but also for deterministic hyperbolic, Schródinger 
and plate equations, which had been derived via Carleman estimates (See 


[Lr], [E87] and [B85], respectively). 
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11.4 Observability Estimate for Backward Stochastic 
Schrodinger Equations 


In this section, we shall prove the desired observability estimate for the back- 
ward stochastic Schrödinger equation (LLA) with 7 = T (See Theorem LIA 
below). To this end, put 


p(x) = |x — zo|? + ø, (11.36) 


where ø is a positive constant such that 
' 5 

min y(x) > -|vlre»(c). 
zeG 6 


Let A > 0 and y > 0. Put 


etev — ebu|v|I roe (a) eth 
PT- ^ VTPT- 





=e. (11.37) 


We first establish the following global Carleman estimate for backward s- 
tochastic Schrödinger equations: 


Theorem 11.13. There are 1 > 0 (depending on rı) and mı > 0 such that 
for each À > A4 and u 2 m, any solution to the equation (LL4) with rT = T 
satisfies that 














J o (apila + Aig| V 2?) dxdt 
* (11.38) 


























<cle f 9 O^ eI? Iv Z|?) dedit + iR | oo| ara], 
Q Xo OV 


Proof: The proof is divided into three steps. 
Step 1. Let 6 = 1 and (DF) ien be the n x n identity matrix. Put 

it: 1, ifj=k, 

0, ifj Ak. 


For any solution (z, Z) to the equation (LLA) with 7 = T, applying Theorem 
NO with 0 given by (C37), u replaced by z and v = z, we obtain that 





ePz (ists —2 3 (5, - Vv) + 8Pz( — ipl — 2 Y la; Va; v) 
j=1 j=1 
+dM +div V (11.39) 


n 2 
= 2| - idv - 29 1 G,vs, + ¥v| dt 
j=l 
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+ e (va, Vay + V5, Va, )dt + D\v|?dt 
j,k=1 
32i V (layt + lizz) (Va, v — va, V)dt + iY + AD) (vdv — vdv) + £|dv|? 


jet 





iM la; (dv, dv — dvz,d¥). 


j=l 
Here " 
M = &|vl? iM le; (VaV — va; V), 
j=l 
A= 3, - las) - V, 
j=l 
D = lu +) Veja; +2) (lx A)a, + 2AY, 
j=l j=l 
IF = 2054, — 83 Ap — diy, 
and 


Vi = —i[£;, (vdv — vdv) + &(vs, V — Vx, v)dt] 
—V (v, V + V4, v)dt + (2AU, + V,,)|v|?dt 


TL T 
a 5 lx; (Va; Var + Vs, Va,)dt — 2 5 lor (Vos dt: 
j-1 j=l 
Step 2. In this step, we estimate the terms in the right-hand side of the 
equality (L39) one by one. 
First, from the definitions of £ and « in (I[L37) and the choice of w in 
(1.36), we have that 











i = bars (ev esie) " 
< | mU qaem « olar- Ta < xoi, : 
and 
Kel = ea 6T? (et^ eS en) | 
< oaar etm (11.41) 


1 
« 8p < 2 < 3 
C agr pit | CAY Crp 
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Let us choose V — — A. Since 





A= ye zy (Apps, )? = 163202 g?| vy, 
j=1 j=l 
we find that 
D = lu + Y Vu; + 23 (lay A), + 2A 
j=l j=l 
= lu + A(AL) +2 3 (AAuprve, 16°" ¢"|V UI"), (11.42) 
j=l 


—32)2 wp? | vp? AC 
= 3843 u^ 9| Vu[* — p POCA) — Xe? O(u?) + 6. 
Recalling that zp € R” \ G, we have |Vij| > 0 in G. This, together with 


(LLZT)-(IIL22), implies that there exists a po > 0 such that for all y > po, 
one can find a constant Ag = Ao(40) so that for any A > Ao, it holds that 


Div? > Apti. (11.43) 
Since 
I? = 26, — 7 ALL FW = 32243 ps Var + 36840, 
we deduce that 
Y c^ (v, Van + Us, Va.) 
jk-1 


TL 


= 16Aup 5 (Que; Po, + Vajen) (Vo; Ver +VerVaz) 
jk-l 


- semol Di Pas Vas) D nas) + Yanan) D (ss ) a4 
j=l 1 =1 j= 


j=l 
= 64)? o| Vy - Vv? + 64sup| Vv? 
> 64Aup|V v|?. 


Now we estimate the other terms in the right-hand side of the equality 
(39). The first one reads 
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loi Se + lis; \(Va;V E vav) 


j=l 
: (11.45) 
= luy Ape, Uv, v — Fva,)| < 2hy|Vv|? + 22,2? | Vp? |v?]. 
j=l 
The second one satisfies 
i(V + Al)(vdv — vdv) = 0. (11.46) 


To estimate the third one, we take mean value and get that 
LE|dv|? = £JE|0£,zdt + 6dz|? = £,0?E|dz|? < 2NO2—p2 E|Z|7dt. (11.47) 


Here we utilize the inequality (LL40). 
Further, 


E(dv.., dv) = E[(6¢,2dt + 0dz), (66,2dt + Odz)] = E[(0d2),,, Odz] 
= E| (Ays, dz + 0dz;, )(6dz)] 

AuUpVr, 0? E|dz|? + 67E(dzZ,, dz) 

= \pyr, 0? E|Z "dt + 0’E(Z2, Z) dt. 















































































































































Similarly, 
































E(dv,, dv) = \upwe, 0 E 
Therefore, the fourth one satisfies that 


Zpat + €?E(ZZ.,)dt. 




















iE La, (dv, dv — dvz,d¥) 
j=l 





(11.48) 




















= iue vs, [P'E(Z.; Z) — 6?E(Z., Z)]at. 


j=l 
Step 3. Integrating the equality (LL39) in Q, taking mean value in both 
sides, and noting (40), (1-41), (ILL23)-(IIE23), we obtain that 


af (Xut |v? uel v?) dedt 



































i 2 
-2E / | itv - 29 la;Va; +] dedi 
Q j=l 
<E L [oPy (itv — 23 ta; Fe, + U7) 


+6Py( — ihv — 2X + vv)| dx 


«cef 0? (5° u |Z|? + |VZ|?)dadt + J dMdz + f div Vdz. 
Q Q 
(11.49) 
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Now we analyze the terms in the right-hand side of (LL49) one by one. 
The first one reads 


z f ePz (ite -2 2 (ss, S) 


+0P2( — ilv —2 5 lx; Va; + vv)| dx 
j=l 


- ef [O (b1 V2 + baz + bs Z) (itv — 2 ya + ww) 
Q j=l 





























+0(— bı - VZ + b22 + bZ) ( — ikv DLE Uv) |dedt 
j=l 


ef (6? [bi - Vz + bez H bg Z|” | iBlrv gx owe e| anat. 
Q j=l 





IA 














(11.50) 
From the choice of 6, it is clear that v(0) = v(T) = 0. Hence, we obtain 
that 


f dMdx = 0. (11.51) 
Q 


Further, noting that v = z = 0 on X, we find 


jd div Vdz 


=Z TEDIS 7 (Va, Va, + V; Vx, )v^ — by Vv Ry, Vs,] d 
5 


k-1j-1 
= JOS ED» Aas 


= r [2S oto! Bel ae so ip Po Z l'ardt. 


It follows from (ILL49)-(IIL.82) that 




















(11.52) 




















Xj 


























J (ute? + Miel V vl) dxdt 
Q 


























«cf Pb at baz + bZ eddie Ci |. o|? [farat (11.53) 
Q 














+C af P(X RPP |Z? + |VZ|?) dadt. 
Q 


Noting that zz, = 07!(Va, — lep V) =O" (va, — MupVs, v), we get 
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0? (V2? + A? g?lz?) < c(IVvf + Xu? v). (11.54) 


Therefore, it follows from (11053) that 














J (8 ue? |z|? + Aug|V z|^) dxdt 
Q 














<e f 6? (lbs IV z|? + WB z|2 + [bsl2|Z|2) decat 
Q 




















sow f. Po * l'ardt + CB J PORZ «Ivzpyasa:. 
Q 








(11.55) 
Taking pı = po and Ai = max(Ao,Cr2), and utilizing the inequality 
(55), we conclude the desired inequality (ILL). oO 


Now we are in a position to establish the following key observability esti- 
mate for the backward stochastic Schrödinger equation (ILJ) with r = T. 


Theorem 11.14. All solutions to the backward stochastic Schrodinger equa- 
tion (LL) with T =T satisfy that 





























Oz 
Cr 
Prlzs, eua SE" (la LiousQqwe) T Z| oraycey): 
(11.56) 
Proof: Noting that 
/ g (Xue ez + IV ZI?) dxat 
Q 
2af 0? (xuez TaazP +|V(Z + a4z)|?) dxdt 
Q 
+f 0? Que la42]? + [V (naz) P) deat, 
Q 
from (ILES), we obtain that 
iP (ute |z|? + Mup|V zl?) dxdt 
<CE yn 0? (xuez + agz|? + |V(Z + aaz)| ?) dadt (11.57) 


2(42,2,.2 2 2 | Oz |? 
+] 0 (^ ue? az + |V(a4z)| ?)dadt + yu 0 oZ] ardt]. 
Q Xo ðv 


Let Az = max{A1,C|a4| zo (o 7. w 1:9 (9) }- Then for all A > A2, we deduce from 
(ILL37]) that 
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J (Bute |2)? + uel V 2?) dxdt 
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<c] f e (xZ + aal + |V(Z 4 a4z) P deat (11.58) 
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ew e |: 


It follows from the definition of £ and 0 (in (ILL32)) that 

















ef 8? (o? z|? + e| Vz |?) dadt 
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z : " (11.59) 
s 2 x S 2 2 
E (e(z)? (+.2)) af, f + |V2|*)dedt, 
J 8 (?|Z + aaz|? + [V(Z + a42)|?)dzdt 
3 (11.60) 
< max (y*(t,2)6(,2))B f (IZ + agz|? + |V(Z + a4z)|?) dxdt 
(z,t)eQ Q 
and 
: 2 |0zp? 2 
ef 0 e[z- dI'dt € max_((t,x)0°(t,x))E l d didt. (11.61) 
Zp (v (s.)eQ 


Combining (39) and (ILL59)-(IIE.GT), we arrive at 


3T 
Ef [r+ IV z|?)dzdt 
i G 


MAX (x peg (e^. z)0? (t, )) 
minseg (ol, 299 (5.2)) (11.62) 


xE f(z asz|? +|V(Z + a4z)|?)dzdt + E la z farat 

















< Cry 





































































































<é" (Ef (IZ + aaz? + |V(Z + a4z)|?)dadt + JA idl drat). 
T 8v 
Utilizing (LL52) and (ILH), we obtain that 
af (ler|? + IVzr[^)dz 
G 
Cr 7 2 2 E Oz |? 
«e [E (IZ + aaz? + |V(Z + a4z)|)) dzdt +E | |= drat], 
Q EQ | OV 


which concludes Theorem TĄ immediately. LI 
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Remark 11.15. The constant eC in (50) can be improved. Nevertheless, 
as we explained before, since we want to present the key idea in a simple way, 
we do not pursue the sharpest result. 


11.5 Notes and Comments 


This chapter is an improved version of the results presented in [228, 229]. 
'There are numerous studies on the controllability and observability of de- 
terministic Schrödinger equations (e.g., Ø, B5, IX, 19, 21, 42, LRA, 190, 252), 
260, 280, 289, BIA, H94]). 
Generally speaking, there are five useful methods to solve the exact con- 
trollability /observability problem for deterministic Schrödinger equations: 


e The first one is based on the Ingham type inequality ([BT7Z]). It can be used 
to solve controllability/observability problem for Schródinger equations 
involved in some special domains, i.e., intervals and rectangles. However, 
people do not know how to apply it to the equations evolved in general 
domains. 

e The second one is the classical Rellich-type multiplier approach ([252]). It 
can be applied to Schródinger equations with (small) time-invariant lower 
order terms. 

e The third one is the microlocal analysis approach ([4, |), which gives 
sharp sufficient conditions for the exact controllability of Schrödinger e- 
quations with time independent lower order terms. 

e The fourth one is the transmutation method ([2Z80]). This method reduces 
the controllability problem for Schródinger equations to the same problem 
but for parabolic equations. 

e The last one is based on the global Carleman estimate (|[I&7, 260]), which 
applies to Schródinger equations with quite general lower order terms but 
the controller is not as sharp as those given by the first and the third 
methods (mentioned above). 


Until now, as far as we know, only the last method was extended to study- 
ing the controllability/observability problem of stochastic Schródinger equa- 
tions (See [224, 228, 229]). Recently, in a very interesting paper [IU], a signifi- 
cant weighted identity for quite general stochastic partial differential operators 
was established, via which one can obtain a unified treatment in establishing 
the weighted identities (including in particular (ECIU), (225) and (ILLT2)) for 
some deterministic/stochastic partial differential operators. Hence, based on 
this identity, some known global Carleman estimates for stochastic transport 
equations, stochastic parabolic equations, stochastic Schrödinger equations 
and so on can be deduced. 

It seems that people will face many essential difficulties to apply the oth- 
er four methods mentioned above to study the controllability problem for 
stochastic Schródinger equations. On the other hand, there are lots of open 
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problems related to the topic of this chapter. In our opinion, the following are 
particularly interesting: 


1) Observability estimate and unique continuation for stochastic 
Schrödinger equations. Consider the following stochastic Schrödinger 
equation: 


idy + Aydt = (ai - Vy + aay)dt + asydW (t) in Q, 


y =0 on X, (11.63) 
y(0) = yo in G. 


As an easy consequence of Theorem [LL T4, we can show that, the solution 
y to (ILEA) equals zero in Q, a.s., provided that y = 0 in a neighborhood 
of Io, a.e. t € (0, T). Compared with the classical unique continuation 
result for deterministic Schródinger equations with time independent co- 
efficients (e.g., Ø, II9U] for example), it seems too restrictive to assume 
that y vanishes in a neighborhood of Io, a.e. t € (0, T). It would be 
quite interesting but may be challenging to prove whether the results in 
m, IT9U] are true or not for stochastic Schrödinger equations. To do this, 
several new tools should be developed in the stochastic setting, such as 
the stochastic counterpart of microlocal defect measure and semiclassical 
defect measure. 

2) Null and approximate controllability for stochastic Schródinger 
equations. As immediate consequences of the main result of this chap- 
ter, we can obtain the null and approximate controllability for the same 
system. However, in order to get these two kinds of controllability, there 
are no reasons to employ two controls. By Proposition [LĦ, it is possible 
to put only one control in the drift term to get the null controllability, 
at least for the system with deterministic coefficients. On the other hand, 
as suggested by the result in Section BJ, we believe that one boundary 
control can guarantee the null and approximate controllability of (IIL3]). 
However, we will meet some essential difficulties to prove such a result. 
For example, to get the null controllability, we should prove that 
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gen «CE f. 5p | dX». (11.64) 
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If we utilize the method in this chapter, we only get that 
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= Oz |? T 
Olgo <æ, f. a | i+ | Zl esc). 
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An extra term Z appears in the right hand side of the above inequality. 
We believe that one should be able to introduce some new technique to 
get rid of this additional term. However, we do not know how to achieve 
this goal at this moment. 
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3) Controllability for stochastic Schródinger equations with bilin- 
ear controls. In practice, it is more convenient to add controls in the 
coefficients of stochastic Schródinger equations. This leads to the control 
system with bilinear controls. An example is as follows: 


idy + Aydt = (a, + u)ydt + (a, +v)ydW(t) in Q, 
y =0 on X, (11.65) 
y(0) = yo in G. 


Here both u and v are controls belong to suitable function spaces. Bilinear 
control for deterministic Schródinger equations are studied extensively in 
the literature (e.g., [I9]). However, at this moment we have no idea on how 
to study the bilinear controllability problem for stochastic Schrödinger 
equations. 


In this book, we consider only controllability /obseverbility problems for 
four kind of stochastic partial differential equations, i.e., stochastic transport 
equations, stochastic parabolic equations, stochastic wave equations and s- 
tochastic Schródinger equations. In recent years, there are some interesting 
works on the same problems but for other stochastic partial differential equa- 
tions, say [IUN] for stochastic complex Ginzburg-Landau equations, [OX] for 
stochastic Korteweg-de Vries equations, [O9] for stochastic Kawahara equa- 
tions, [Z0] for stochastic fourth order Schrödinger equations, [21] for stochas- 
tic Kuramoto-Sivashinsky equations, [142] for stochastic coupled systems of 
fourth and second-order parabolic equations, [222] for stochastic degenerate 
parabolic equations, [B58] for stochastic Grushin equations, and [BUI] for s- 
tochastic beam equations. As far as we know, there are no results on the con- 
trollability /obseverbility problems for stochastic plate equations, stochastic 
Maxwell equations, stochastic Benjamin-Bona-Mahony equations, stochastic 
elasticity /thermoelasticity equations, stochastic hyperbolic-parabolic coupled 
systems, stochastic Navier-Stokes equations and atmospheric equations in par- 
ticular, etc. In our opinion, the direction of controllability /obseverbility for 
stochastic partial differential equations is full of open problems, and very likely 
people need to develop new tools to solve some of them. 


f 


Check for 
updates 
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Pontryagin-Type Stochastic Maximum 
Principle and Beyond 


'The main purpose of this chapter is to derive first order necessary conditions, 
i.e., Pontryagin-type maximum principle for optimal controls of general non- 
linear stochastic evolution equations in infinite dimensions, in which both the 
drift and the diffusion terms may contain the control variables, and the con- 
trol regions are allowed to be nonconvex. In order to do this, quite different 
from the deterministic infinite dimensional setting and the stochastic finite di- 
mensional case, people have to introduce a suitable operator-valued backward 
stochastic evolution equation, served as the second order adjoint equation. It 
is very difficult to prove the existence of solutions to this equation for the 
general case. Indeed, in the infinite dimensional setting, there exists no such a 
satisfactory stochastic integration/evolution equation theory (in the previous 
literatures) that can be employed to establish the well-posedness of such an 
equation. 

To overcome the above-mentioned difficulty, we employ our stochastic 
transposition method to introduce a concept of transposition solution/relaxed 
transposition solution to the desired operator-valued backward stochastic evo- 
lution equation, and develop carefully a way to study the corresponding well- 
posedness. 

We shall also consider very quickly first order sufficient conditions and 
second order necessary conditions (for optimal controls), while the latter re- 
lies also essentially on the above well-posedness result, in particular on the 
characterization of the correction part in the above operator-valued backward 
stochastic evolution equation. 


12.1 Formulation of the Optimal Control Problem 


Throughout this chapter, T > 0, (Q, F, FE, P) (with F 2 Fiet) is a fixed 
filtered probability space satisfying the usual condition, and we denote by IF 
the progressive c-field w.r.t. F; H and V are two separable (complex) Hilbert 
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spaces (unless other stated); {h;}92, and ([ej]52, are respectively orthonor- 
mal basis of H and V; we denote by I the identy operator on H, and write 
£? 2 L(V; H ). Unless otherwise specified, W(-) is a V-valued, Q-Brownian 
motion or cylindrical Brownian motion but we only consider the case of cylin- 
drical Brownian motion. 

Let A be an unbounded linear operator (with domain D(A) on H), which 
generates a Co-semigroup (S(t));so. Denote by A* the dual operator of A. 
Clearly, D(A) is a Hilbert space with the usual graph norm, and A* is the 
infinitesimal generator of {S*(t)}i>0, the dual Co-semigroup of {S(t)}:>0. For 
any A € p( A), the resolvent of A, denote by A, the Yosida approximation of 
A and by {S)(t)}zer the Co-group generated by A). Let U be a separable 
metric space with a metric d(-,-). Put 


2 (u(-) [0, T] x (2 > U | u(-) is F-adapted} (12.1) 


Throughout this chapter, Cr, > 0 is a generic constant, and we assume the 
following condition: 

(S1) Suppose that a(-,-,-) : [T] x 2x H xU  H and b(-,-,-) : [0, T] x 2x 
H x U — L} are two (vector-valued) functions satisfying: i) For any (x,u) € 
H xU, the functions a(-, x,u) : [0, T] x 2 > H and b(-, x,u) : (0, T] x 2 > £$ 
are F-measurable; ii) For any x € H and a.e. (t,w) € (0, T) x Q, the functions 
a(t,z,-) : U > H and b(t,z,-) : U — L} are continuous; and iii) For any 
(z1,229,u) € Hx H x U and a.e. (t, c) € (0, T) x 2, 


a(t, x1, u) — a(t, 2, u)| zn + |b(t, x1, u) — b(t, £2, u)|co < Cr|z1 — x2| 7, 
la(t, 0, u)| gp + b(t, 0, u)| zo EX Cr. 


Let us consider the following controlled stochastic evolution equation: 
dx(t) = (Azx(t) + a(t, x(t), u(t))) dt 
+b(t, x(t), u(t) )dW (t) in (0, T], (12.2) 
x(0) = T0, 
where u(-) € U[0, T] is the control variable, x(-) is the state variable, and the 
(given) initial state zo € L/? (2; H) for some given po > 2. 
In the rest of this chapter, we shall denote by C a generic constant, de- 
pending on T', A, po (or p to be introduced later) and Cr, (or J and K to 


be introduced later), which may be different from one place to another. By 
Theorem B.14, it is easy to show the following result: 


Proposition 12.1. Let the assumption (S1) hold. Then, for any xo € LE (Q; 
H) and u(-) € u(0, T], the equation (Z2) admits a unique mild solution 
x(-) = z(^ ; zo, u) € Cg([0, T]; LP» (2; H)). Furthermore, 


Ix) les(o;rizpo (9:2) € C(1 + lzolzzo co.) 
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Also, we need the following condition: 


(S2) Suppose that g(-,-,-) : [0,T] x 2x H xU >R and h(-) : Qx H > R are 
two functions satisfying: i) For any (x,u) € H x U, the function g(-,x,u) : 
[0, T] x (2 > R is F-measurable, the function h(x) : R > R is Fr-measurable; 
ii) For any x € H and a.e. (t,w) € (0, T) x Q, the function g(t,z,-) : U => R 
is continuous; and iii) For any (z1,23,u) € H x H x U and ae. (tw) € 
(0, T) x 2, 


| Ig(, 21, u) — g(t, v2, u)] + |h(1) — h(2)] € Cz|z1 — volg, 
g(t, 0, u)| + |h(0)] < Cz. 


Define a cost functional 7(-) (for the controlled system (IQ) as follows: 











J (u()) 





T 
«(f a(t,2(t),u(t))dt + AT), Vu) EUT], (123) 


where x(-) is the corresponding solution to (Z2). We consider the follow- 
ing optimal control problem for the controlled equation (22) with the cost 
functional (123): 


Problem (OP) Find a u(-) € U[0,T] such that 


J(u(.)) = J (u(-)). (12.4) 


inf 
u(-) €U[0,T] 


Any u(-) € U[0, T] satisfying (ZA) is called an optimal control. The cor- 
responding state z(-) (of ([L222)) is called an optimal state, and (z(-), u(-)) is 
called an optimal pair (of Problem (OP)). 

'The main goal of this chapter is to establish a first order necessary condi- 
tion for optimal pairs of Problem (OP), in the spirit of the classical Pontrya- 
gin maximum principle for deterministic finite dimensional controlled systems 
([281]). Also, we shall consider very quickly the related first order sufficient 
(optimality) condition and second order necessary (optimality) condition. 

Stimulated by [273], for the case of general control regions, we need to 
assume the following further conditions 


(S3) For any u € U and a.e. (t,w) € (0, T) x 2, the functions a(t,-,u) : H > 
H, b(t,-,u) : H > £$, g(t,-,u) : H > R and h(-) : H  R are C?. For 
any x € H and a.e. (t,w) € (0, T) x 2, the functions az(t,z,-) : U > L(A), 
b.(t,2,-) : U 2 £(H; £3), go (t, x, ) : U > H, ags(t, 2, ) : U > L(A, H; H), 
bea (t,@,:) : U — L(H, H; LÌ) and ges(t,v,-) : U + L(A) are continuous. 
Moreover, for any (x,u) € H x U and ae. (t,w) € (0, T) x 2, 


! See Subsection ZILI for the notations £(H, H; H) and £(H, H; £$). 
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[as (t, x, u)|ccH) T [bs (t, £, u)| e (nr; c9) us [gs (t, £, u)|n = [ha (x) |x s Cr, 
laa (t £, u)| e ar nsn) [bea (t, £, wu) ler rico) 


t [gas (t, ©, u)|e car) + has x)| eur) 
<C. 


Problem (OP) is now well-understood for the case of finite dimensions 
(i.e., dim H < oo) and natural filtration. In this case, a Pontryagin-type max- 
imum principle was obtained in [273] for general stochastic control systems 
with control-dependent diffusion coefficients and possibly non-convex control 
regions, and it was found that the corresponding result differs significantly 
from its deterministic counterpart. 

At first glance, one might think that the study of Problem (OP) is simply 
a routine extension of that in [273]. However, the infinite dimensional setting 
leads to significantly new difficulties. To illustrate this, we first recall the main 
idea and result in [273]. Suppose that (z(-), u(-)) is a given optimal pair for 
the special case that A = 0, H = R" (for some n € N), V = R, po = 2 and F is 
the natural filtration generated by W(-). First, similarly to the deterministic 
setting, one introduces the following first order adjoint equation (which is now 
however a backward stochastic differential equation in the stochastic case): 


dy(t) — - (a«(t. H(t), u(t)) ' y(t) + bs (t x (t), u(t)) TY (t) 
-s.(62(),20))ateY()nw() — mpr, — U?9 
y(T) = —hs(x(T)). 

In (ILZ3), the unknown is a pair of F-adapted processes (y(-), Y (-)) € L2(02; 
C([0, T]; R?)) x L2(0, T; IR"). Next, to establish the desired maximum principle 
for stochastic controlled systems with control-dependent diffusion and possibly 
nonconvex control regions, it was found in [273] that, except for the first order 
adjoint equation (Z), one needs to introduce an additional second order 
adjoint equation as follows: 


dP(t) = — (a«(t, a(t), (0) PO) + P(t)a0(t, 2), u(2)) 
bx (t, x (t), u(t)) 





b. (t, E(t), u(t)) ! P(t) 
b. (t, E(t), u(t)) Q(t) + Q(t)bs (t, F(t), u(t)) (12.6) 
Has (t, (t), U(t), y(t), Y(t) at + + Q(t)aW(t) in [0,7] 





H(t, x, u, y1, y2) = (ya (t, T ,'u) )g» + (ga; b(t, x,u) Jin —g(t, x,u), 
(t,w, x,u, y1, y2) € [0, T] x 2x R” x Ux R” x R”. 


12.1 Formulation of the Optimal Control Problem 391 


Clearly, the equation (IZU) is an R"*"-valued backward stochastic differ- 
ential equation in which the unknown is a pair of processes (P(-), Q(-)) € 
L2(0; C([0, T]; R”*”)) x L2(0, T; R"*"). Then, associated with the 6-tuple 
(z(-), ü(-), y Y C), PC), Q(-)), define 


H(t, x, u) 2m, x,u, y(t), Y (t)) + H P(t)b(t, x,u), b(t, v, u) Jgn 


—( P(t)b(t, E(t), u(t)), b(t, x, u) Jgn- 


The main result in [273] asserts that any optimal pair (z(-), u(-)) satisfies the 
following maximum principle condition: 


H(t, x(t),u(t)) = max H(t, Z(t), u), a.e. t € [0, T], as. 


It is easy to see that, in order to establish the Pontryagin-type necessary 
conditions for an optimal pair (z(-), u(-)) of Problem (OP), we need to intro- 
duce first the following H-valued backward stochastic evolution equationÉ: 


dy(t) = —A*y(t)dt — (ast. 2), w(t))*y(t) + b, (t, x (t), u(t))" Y (t) 
-ga (t, (t), U(E) Jdt + Y (t)4W (f) in [0, T), (12.7) 


y(T) = —-h.(z(T)), 


which will serve as the first order adjoint equation. By Theorem ELTG, the 
equation (IZ) is well-posed in the sense of transposition solution (Note that 
we do not assume the filtration F is the natural one). 

Next, inspired by [273], to deal with the case of possibly non-convex control 
region U, for any p € (1, 2], we need to introduce the following formally £(H)- 
valued backward stochastic evolution equation: 


dP = —(A* + J*)Pdt — P(A + J)dt — K*PKdt 
(K*Q + QK)dt + Fdt + QIW (t) in[T) (128) 
P(T) = Pr, 





where (q — p/(p — 1)), 
FELAO TIO L(H))), KELAOTL” (R; L(H;L9))), (12.9) 
F € LẸ(0, T; LP (Q; £(H)), Pr € LE, (0; £(H)). (12.10) 


For the special case when H = R”, similarly to (£9), it is easy to see that 
(ZX) is an R"*” (matrix)-valued backward stochastic differential equation 


? Throughout this book, for any operator-valued process (resp. random vari- 
able) R, we denote by R* its pointwise dual operator-valued process (resp. 
random variable). For example, if R € Li(0,T;L?(Q;£(H))), then R* € 
Lp(0, T; L? (2; C(H))), and || rito r2 (0:600)) = VU Ózitoriz2 (0c: 
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(which can be easily regarded as an R”? (vector)-valued backward stochastic 
differential equation), and therefore, the desired well-posedness follows from 
the one for backward stochastic evolution equations valued in Hilbert spaces. 

One has to face a real challenge in the study of (228) when dim H = oo, 
without further assumption on the data F and Pr. Indeed, as we mentioned 
in Remark 2.62, in the infinite dimensional setting, although £(H) is still a 
Banach space, it is neither reflexive (needless to say to be a Hilbert space) 
nor separable. To the best of the authors’ knowledge, in the previous litera- 
tures there exists no such a stochastic integration/evolution equation theory 
in general Banach spaces that can be employed to treat the well-posedness 
of (IZA) in the usual sense, even if the filtration F is the natural one. For 
example, the existing results on stochastic integration/evolution equation in 
UMD Banach spaces (e.g., [B28, H29]) do not fit the present case because, if a 
Banach space is UMD, then it is reflexive. 

From the above analysis, it is clear that the key to establish the Pontryagin- 
type stochastic maximum principle for optimal pairs of Problem (OP) is to 
give a suitable sense of solutions to the equation (IZA) and prove the corre- 
sponding well-posedness. For this purpose, we shall adopt the stochastic trans- 
position method developed in our previous work [241], which was addressed to 
the backward stochastic differential equations in R” (See also Section (in 
Chapter Hl) for the well-posedness of H-valued backward stochastic evolution 
equations in the sense of transposition solutions). 

The rest of this chapter is organized as follows. In Section IZZ, we review 
the Pontryagin maximum principle for optimal control problems of stochastic 
differential equations. In Section [LZ.3, a necessary condition for optimal con- 
trols for convex control domains is given. Section [ZA is devoted to the study 
of operator-valued backward stochastic evolution equations. In Section ZA, 
we establish the Pontryagin-type maximum principle for optimal controls for 
convex control domains. In Section ZG, we give a sufficient condition for 
the optimal control. In Section ZJ, we give some integral-type second or- 
der necessary conditions for optimal controls. Finally, some remarks and open 
problems are given in Section ZA. 


12.2 The Case of Finite Dimensions 


In this section, we consider the special case that A= 0, H = R” and V = R 
(and hence {W (t) }rejo,r] is a one dimensional standard Brownian motion). As 
we mentioned before, for this case the well-posedness of the equation (ZX) 
follows from the one for R^ (vector)-valued backward stochastic differential 
equations. 

Let (z(-),u(-)) be an optimal pair for Problem (OP). Note that we do 
not assume F is the natural filtration in this section. Hence, the solution 
(y), Y()) € De([0, T]; L2(2; R”)) x L2(0, T; R^) to (Z3) is understood 
in the sense of transposition solution. By taking an inner product in IR"*" 
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as (Pi, P2)pnxn = tr(P,P,) for any n x n matrices Pj and Pz, as a di- 
rect consequence of Theorem HIG, we see that the equation (IZE) admit- 
s a unique transposition solution (P(-), Q(-)) € Dg([0, T]; L5 (Q; R"^*")) x 
LEO L? (0, T; R”*”)). 

We have the following Pontryagin-type maximum principle for optimal 
pairs of Problem (OP). 


ce 12.2. Let (S1)-(S3) hold (for H = R” and V = R) and xo € 
L5. (Q; IR"). Then, for any optimal pair (z(-), u(-)) of Problem (OP), it holds 
that 


H(t, x(t), u(t), y(t), Y (t)) — H(t, z(t), u, y(t), Y (t) 
—z(P(t)(b(t, Z(t), u(t)) — b(t, E(t), u)), b(t, Z(t), u(t)) — b(t, E(t), U)) en 
> 0, VucU, ae.tc[0,T], as. 


mÓ 


(12.11) 


Sketch of the proof of Theorem IZA: The detailed proof of this theorem 
is very close to that of [273, Theorem 3] and B7, Theorem 3.2 in Chapter 
3] (addressed to the stochastic maximum principle for controlled stochastic 
differential equations with the natural filtration generated by W(-)). Hence, 
we only give below a sketch of proof for this theorem. 

Fix any u(-) € U[0, T] and € > 0. Similar to (£44), let 

B t € [0, T] \ Ez, 
uF (t) = 
u(t), t€ Ee, 


where E; C [0, T] is a measurable set with the Lebesgue measure m(E;) = e. 
For w = a,b, f and g, we write 


Wilt) = v (t, Z(t), u(t)), 

Pilt) = Vas (t. Z(t), u(t)), 

óv(t) = v(t, Z(t), u(t)) — v(t, Z(t), u(t)), 
õpi (t) = vi (t, Z(t), u(t)) — vs (t, T(t), u(t)). 


Suppose that z£(-) and z$(-) solve respectively the following stochastic differ- 
ential equations 


l dxf (t) = ai (t)xf(t)dt + (bı (t)x$ (t) + xr. (t)6b(t))dW(t) in (0, T], 
xī(0) — 0, 


and 
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da(t) = (a (0250) + xa Odali) + Fan (nt, 21) at 


+ (02H + xe (tbs (05 (0 + 2 (0 (50,50) dw (t 
in (0,77, 
x5(0) = 0. 


Then, when £ — 0, by a very similar argument to the proof of [37T, Theorem 
4.4 in Chapter 3] (See B, pp. 128-134]), one can obtain that 


J (u^ ()) — IE) 


= E(h. ((T)), a5(T) + 25(T) pn + ; EChss (2 (T))o5 (T), 1 (7) 






































T 
4 : (ale) i) t £5(t)) pn + s (n (2 (0. (0). 


"xs, (1)dg(t)) dt + ole). 


Since (y(-), Y (-)) is the transposition solution to the equation (Z8), we find 
that 














—E(hs (z(T)), x5 (T)) pn 





























: (12.13) 
=E f (Cei (t), 2E) Jra + Xe (0 SOC), Y (£)) s.) dt, 
and 
-E (ha (z(T)), x5 (T))gs 
T Z T E E 
-E f [K020 + FUO OOO) an (12.14) 
) 


(Y (t), bir (t) (21 (0, Ti (E)) en) 
xe, (t) dato), Qr. 25 (0). d 


Further, put z$(t) = xE (t)z (t)! (€ R"*"). By Itó's formula, we get that z5(-) 
solves 


da§(t) = [ax (0250) + as (t)ai(£)  -- b1(t)2§(t)bi(t)’ + xm, (t)ób(t)ób(t) " 














xis (t) (bi (DLEET + ób(t)a3(£) "bn (0) ) | dt 


F [bs (6) (6) + aS(t)bi(t) ^ (12.15) 





xs, (O (BOAT HHT) Jawe) — im (0,71, 
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Using the fact that (P(-), Q(-)) is the transposition solution to the equation 
(IZH) and noting that the inner product defined in R?*" is tr(P P) for 
P,, P) € R?*", we find that 


—E tr (has (z(D))2$(1)) 


























T 
=E [ tr (xm (000 (0) PESCE) — Hea (t, zt), a(t), w(t), Y (0))v8(0))dt 
+o(e), 
which gives that 


—E(heo(#(T))24(T), 25 (T). 






































-3 (P9), 8b)... ) dt + ofe). 
(12.17) 
Since ü(-) is an optimal control, we have J (u*(-)) —J (u(-)) > 0. This, together 
with (ZTA), yields that 














T 
Ji XE. (t) (ne. z(t), u(t), y(t), Y(t)) n H(t, z(t), u(t), y(t), Y(t)) 
1 
-5(P(0900, BB(t)) an ) dt 
> o(e), 
which gives (Z). o 
12.3 Necessary Condition for Optimal Controls for 


Convex Control Regions 


In this section, we shall present a necessary condition for optimal controls of 
Problem (OP) under the following condition: 
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(S4) The control region U is a convex subset of a separable Hilbert space H 
and the metric of U is introduced by the norm of H, i.e., d(uj, uz) = |uy—uz|g. 


We begin with the following preliminary result. 
Lemma 12.3. If F(-) € L2(0, T; H) and ü(-) € u[0, T] such that 














T 
Re J (F(t,-), u(t,-) — u(t,-)) gdt < 0, (12.18) 
0 


holds for any u(-) €U[0,T] satisfying u(-) — ü(-) € L2(0, T; H)), then, 


Re(F(t,u),u— ü(tu))g € 0, ae. (t,w) € [0,T] x 2, VueU. (12.19) 


Proof: We use a contradiction argument. Suppose that the inequality 
(219) did not hold. Then, there would exist a uo € U and an £ > 0 such 


that a 
Qe a n XA, (t,w)dtdP > 0, 
Q Jo 


Ae = {(t,w) € [0,T] x 2 | Re(F(t,w), uo — ü(to))g > e}. 


where 


For any m € N, define 
Acn 2 Aen (to) € [0, T] x Q | Ja(t;o)|g € m}. 


It is clear that lim Aem = Ae. Hence, there is an me € N such that 
m-—oo 


Tos Xdem (t,w)dtdP > $ > 0, V m 2 me. 


Since (F(-), uo — u(-)) g is F-adapted, so is the process x4, ,, (-). Define 
ûe m(t, w) = UOXAe,m (t,w) E» u(t, c)X 4e m (t,w), (t,w) € (0, 7] x 22. 


Noting that |u(-)]; < m on Aem, we see that tzm(-) € U[0,T] satisfies 
diem(-) — u(-) € L2(0, T; H). Hence, for any m > mz, we obtain that 














T 
Re Ji (F(t), Gem (t) — u(t)) gdt 


J' 
= f n XAcm (t, w)Re (F(t,w), uo — ü(t,i)) g dtP 
RJO 


T 
TNI XA an | 
2/0 
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which contradicts (ILZ.TH). This completes the proof of Lemma Z3. o 
In this section, we introduce the following further assumptions for a(-,-,-), 
b(-, E a, gts ^ -) and h(-). 
(S5) For a.e. (t,w) € (0, T) x R, the functions a(t,-,-): H x U > H and 
g(t 


b(t,-,- ): Hx U > L$, sJ HUSE and AC) H cR ae C3 
Moreover, for any (x,u) € H x U and ae. (t,w) € (0, T) x Q, 


l [aa (£, x, u)| e) Es [bs (t, £, U)| carie) + [ga (t, x, u)| n + lha (x) |x < Cr, 
[ax (t, £, u)] egi. ry + [bu (t, £, u)| ctii. coy F [gu (t, x, u)|g S Cr. 


We have the following necessary condition for optimal controls for Problem 
(OP) with convex control domains. 


Theorem 12.4. Assume that the assumptions (S1)—(S2) and (S4)-(S5) hold. 
Let xo € L3- (25 H) and (z(-),u(-)) be an optimal pair for Problem (OP). 
Then, 


Re (au (t, E(t), W(t)" (t) + bu (t, E), E) Y (t) — gu (t, U(t), E) u — W(t) a 


<0, a.e. (t,w) € [0,T] x 2, Vue U, 
(12.20) 
where (y(-), Y (-)) is the transposition solution to the equation (ZD). 


Proof: We use the convex perturbation technique and divide the proof into 
several steps. 


Step 1. For the optimal pair (z(-), u(:)), we fix arbitrarily a control u(-) € 
U0, T] satisfying u(-) — u(-) € L2(0, T; H)). Since U is convex, we see that 





u^() = u(-) + elul) — u()) = (17 e)uC) + eu) eu[0, T], Vee [0,1]. 


Denote by z*(-) the state process of (IZ) corresponding to the control u* (-). 
By Proposition [Z], it follows that 


|x" |\cp((0,7);22(Q;H)) € € (19 lro|z2. (9:11): V € € [0, 1]. (12.21) 
Write z$(-) = Te — &(-)) and õu(-) = u(-) — à(-). Since (z(.), à(-)) satisfies 


(LL22), it is easy to see that z$£(-) satisfies the following stochastic evolution 
equation: 


zm (12.22) 


where for v» = a, b, 


l dx{ = (Az{ + a$at + aĝôu)dt + (ba + b§6u)dW(t) in (0, T], 
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Ysl) = / Yalt, E(t) + neat (t), u (£))do, 
" (12.23) 


1 
v5(t) -| V (t, z(t), u(t) + cedu(t))do. 
0 
Consider the following stochastic evolution equation: 
dzz = (Ax + ay(t)x2 + a2(t)du)dt + (b1(t)x2 + be(t)du)dW(t) in (0,7), 


x2(0) = 0, 
(12.24) 
where for Y = a,b, 


p(t) = Yalt, T) u(t), ^ v»(t) = Vult, Z(t), u(t)). (12.25) 
Step 2. In this step, we shall prove that 
Jm. |z] — x2|re«(o,r.L2 (9,1) = 0- (12.26) 


First, applying Theorem ETA to (12-22) and by the assumption (S1), we 
find that 


sup Elzi(t)[ 























t€ [0,T] 
" T 2 T 

« CE ( i |a5(s)5u(s)| ds) + f [b5(s)6u(s)|20ds| (12.27) 
i 0 0 
7 2 

< Clu -— u| ato T; Ry 





By a similar computation, we obtain that 











sup E|z»(t)|5 € Clu — 
te[0,T] 





|p 
UL r2 (o; Fr) (12.28) 


On the other hand, put z$ = xj — x5. Then, z$ solves the following equa- 
tion: 


da = [Ax§ + aS (t) + (a(t) — ai(#))a2 + (aS(t) — a2(¢)) dul dt 
+ [bj (t) + (bi (t) — bx (t)) x2 + (05 (t) — b2(t))duldW(t) in (0,7), 
x$(0) = 0. 

















(12.29) 
Applying Theorem EITA to (1229), we obtain that 
ax, Els OL 














T 
< CE (la(s) — a (s)|) + [bi (s) — bis) arc) lo GS) 
0 


* (le(s) — axle io + 165C) — bo ep Ils) = aC d. 
(12.30) 
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Note that (IZZA) implies z^(-.) — z(-) (in H) in probability, as € > 0. 
Hence, by (2-23), (ILZ25) and the continuity of az(t,-,-), ba(t,- -), @u(t,-,-) 
and b, (t, -,-), and noting (228), we deduce that 














Tq 
Ji (lai (s) =al) uy + 10§(8) — bx) seg) len D 


+ (|a§(s) — az (S), + 108(s) — oS) og ns) — a); ]ds = 0. 


This, combined with (ILZ-3U), gives (2220). 


Step 3. Since (z(.),u(-)) is an optimal pair for Problem (OP), from 
(220), we find that 


J (u C) - J (uC)) 





0 «€ lim 
e—0 














T 
= Re Ef (fn (0. 22() n + (g2(t), 6u(t)) g ) dt (12.31) 
HE(hs (T), va (T) | 


where gi(t) = gx(t, z(t), u(t)) and ga(t) = gu(t, Z(t), u(t)). 
By the definition of the transposition solution to (2%), it follows that 






































T 
—E(h, (z(T)), xo(T)) y — J (g(t), va (t) ydt 
is (12.32) 














T 
E f ((a2(t)5u(t),y(t)) y + (P(E), Y (E) pa ) dt. 


Combining (IEZ3T) and (32), we find that 














T 
Re e f (ax(t)* y(t) + ba (0*Y (t) — ga(t), w(t) — u(t)) gdt <0 (12.33) 


holds for any u(-) € U[0,T] satisfying u(-) — ü(-) € L2(0,T; H)). Hence, 
by means of Lemma Z3, from ([L33), we conclude the desired inequality 
(12220). This completes the proof of Theorem Z4. Oo 


12.4 Operator-Valued Backward Stochastic Evolution 
Equations 


This section is addressed to the well-posedness and regularity of solutions to 
the operator-valued backward stochastic evolution equation (2.3). 
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12.4.1 Notions of Solutions 


In this subsection, we shall define the solution to (ZX) in the transposition 
sense. 

We begin with some simple observation. Any Q € L(L3;H) induces a 
formal bilinear functional V(.,-) on H x £9 as follows: 


UT 


Il 
m 


V(h, v) (Q(ej & h), ve; ) y, Vie Hive ce. (12.34) 


J 


Here, e; &h is defined by (ZIX) (Clearly, e;@h € £9, and therefore Q(e;@h) € 
H). Recall that £9 = £3(V; H). It is easy to show that W(-,-) is a bounded 
bilinear functional on H x £$ provided either dim V < oo or Q € £a(£$; H). 
When W(-, -) is a bounded bilinear functional on H x £}, it determines uniquely 


a bounded linear operator Q : H — £9 satisfying 
W(h,v) =(Qh,v)po, VRE H,veE Lh. 


In this case, we say that Q induces a bounded linear operator Q : H > L}, 
and by (234), we have 


( Qh, v) jo =) (Qe; Qh), vej) y, YVheH, veL}. (12.35) 


Me 


ll 
MN 


Jj 


7 On the other hand, any Q € £(H; £9) induces a formally linear operator 
Q : L} > H, defined by 


oo oo oo 
A A ) 
Q( , Qijei Q h;) = , ai; (Qhj)ei, V Qij € C with y lai;l? <00: 
i, j=1 ij=l ij=1 


(12.36) 
It is easy to show that, if Q is a bounded linear operator from £9 to H, then 


Q(v & h) = (Qh)v, VocV,heH. (12.37) 


In this case, we say that Q induces a bounded linear operator Q : £3 > H. It 
is easy to show that Q is a bounded linear operator provided either dim V « oo 
or Q € £3(H; L$). 

Now, suppose that Q € £(£9; H) induces a bounded linear operator Q : 
H — L} and Q induces a bounded linear operator Q : £9 — H. Then, 
Q = Q. Conversely, suppose that Q € £(H;£$) induces a bounded linear 
operator Q : £ — H and Q induces a bounded linear operator Q : H > £9. 
Then, Q = Q. 

We shall need the following result. 
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Proposition 12.5. Any A € £3(V; Lə(H)) induces (uniquely) a bounded lin- 
ear operator Q € £3(£9; H) and a bounded linear operator Q € £3(H; £9) 
satisfying (12:35) and 


Q(v & h) = (Av)h, YveV, heH. (12.38) 


Moreover, 7 
lQ\co(c9:H) + llea € CMe) 


Proof: As in (ILZ38), we define a linear operator Q from £} to H by 


Q( Qijei Q h;) = 5 aij(Aei)hj, V Qij € C with 5 lai;l? « oo. 
i,j—1 ij=l i,j=l 


By A € L2(V; £3(H)), it is easy to check that Q € £L2(L3; H) and 
lQlco(29:H) € ClAlcovica(H)): 


Then, Q induces a bounded linear operator Q € £a(H; £9) satisfying (235) 
and 7 

Qla (arco) € CIQl es ceo; m. 
This completes the proof of Proposition ZA. Oo 


Let us introduce the following two (forward) stochastic evolution equa- 
tions: 


Pena Sere Me 
c(t) 2 & 
and 
dz; = (A+ J)zads + uads + Kv2dW (s) + vadW(s) in (t, T], (12.40) 
X2(t) = £2. 


Here £1, £2 € L22 (Q; H), uuz € L2(t, T; L?*(0; H)), and v1, v2 € L2(t T; 
L?4(Q; C9)). Also, we need to introduce the solution space for (ILZN). For this 
purpose, write 

Drw (0, T]; LP (2; £(H)) 

-2p. 
2 (P6.9 | PC.) € Lpa( LAO, T; (0; H)); P0, LE” (0; H), 
2p 
ae <fe( eH Bs > 
PC, JEE De(li, T]; LAŽ (0; H)) and [PO YE e o 


= Clél 25 (2,1) for every t € [0, T] and £ € 123 (4; H) 
(12.41) 
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and 
Lg (0, T; L (Q; £(£5; H))) 
2 (96.9 | QC) € Lpa(LR(0, T; D? (0; £3); LA, T; LFF (05 H))), 
and Q(t,w) induces a bounded linear operator Q(t, w): H > L$ 


for a.e. (t,w) € [0, T] x o). 


(12.42) 
We now introduce the notion of transposition solution to (23) as follows: 


Definition 12.6. We call (P(-), Q(-)) € Drw ([0, T]; L^ (2; £(H))) x Lg w(0, T; 
L"(Q;£(C9; H))) a transposition solution to (ZX) if for any t € [0,T], 
&,& € LEC; H), w(),u() € LR(5T;L"(0;H)) and m(-),v2(-) € 
L2(t, T; L?3(00; £9)), it holds that 


























T 
E(Prai(T), z2(T)) 4 — J (F(s)a1(s),#2(s)) yds 


























T 
= E(P(t)&1, £2) y + Bf (P(syui (s), v2(s)) yds (12.43) 








ES 














T T 
+ f (P(s)21(s), u2(s)) yds + f (P(s)K(s)x1(5), va(s)) pods 








T 
+ e f (P(s)v1(s), K(s)x2(s) + v2(8)) pods 


























T m. 
+E | (Qel) ns) uds +E | (Qin (9) (9) ds 


Here, z1(-) and x2(-) solve (TZ39) and (IZ), respectively. 


We have the following uniqueness result for the transposition solution to 


Z3). 


Theorem 12.7. If p € (1,2], and J, K, F and Pr satisfy (TZ) -(LZ-TU), 
then the equation (L8) admits at most one transposition solution (P(-), Q(-)) 
€ Drw ([0, T]; L"(0; C(H))) x Lg, (2; L° (0, T; £(C9; H))). 


We shall give a proof of Theorem ZZ in Subsection ZZA. 


Clearly, Definition [ZU looks quite natural. However, the corresponding 
well-posedness of (ZX) is still unsolved. Because of this, we introduce below 
a weaker concept of solution to (ZX). 

Write 


Hy $ L3 (O H) x AETIA H)) x D2(6 T; (0; £9), Vt po, T), 


3 In (I3), Q(-) is the (pointwise defined) operator induced uniquely by Q(-). 
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and 
Q (0, T] 
- [(909,Q0) | QO, QO e LHe Lit T; Le (0; £9) (12.44) 
and QU (0,0,-)* = QU (0,0, -) for any t € (0,7). 


We now define the notion of relaxed transposition solution to (3) as 
follows: 


Definition 12.8. We call (P(-), QO, QO) € Dg([0, T]; L"(0; £(H))) x 
QPI0, T] a relaxed transposition solution to the equation (ILZN) if for any t € 
[0, T], E1, E2 € L£ (Q; H), ui (-), ua(-) € Lg(t, T; L3 (02; H)) and vi(-),va(-) € 
Lg(t,T; L74(Q; C9)), it holds that 


























T 
E(Pray(T),£2(T)) 4 — J (F(s)a1(s),#2(s)) yds 


























T 
= E(P(t)61, E2) y + ef (P(syui (s), v2(s)) ds (12.45) 














+E 








T 
(P(s)a1(s), us(s)) yds + J (P(s)K(s)x1(s), va(s)) pods 





+E 





(P(s)v1 (s), K(s)zo(s) + v2(8)) po ds 





+E 





(vi (s), QU (£5, ua, v3) (s)) pods 











-HE (QU (& ux, v1) (s), va(5)) pods, 





where x1(-) and xa3(-) solve respectively (IZ39) and (40). 


We refer to Remark ILZ TII for the relationship between transposition solu- 
tions and relaxed transposition solutions. 

We have the following well-posedness result for the equation (ZZ) in the 
sense of relaxed transposition solution. 


Theorem 12.9. Assume that p € (1,2] and the Banach space Li- (0; C) is 
separable. Then, for any J, K, F and Pr satisfying (ZD) -(ILZ-IU), the equa- 
tion (ZH) admits one and only one relaxed transposition solution (P(-), QO, 


QO) € Dew ([0. T]; L^ (2; £(H))) x Q^[0, T]. Furthermore, 


^ By Theorem and noting £3 is a Hilbert space, we see that Q@ (0,0, )* is a 
2 
bounded linear operator from L2(t,T; La (Q; £9))* = L2(t, T; L?4(Q; £3)) to 
2 a 
LẸ (t, T; L*(0; £9)) = L(t, T; L7“ (02; £$)). Hence, Q® (0, 0,-)* = Q9 (0,0,-) 


makes sense. 
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IP ciao sco zo T2" C+ (01) 


t) At 
T. L9 QU L2(G,T;L2»/G (2;£3)))? (12.46) 


< C(lFlry7,7; L*(Q;£(H)) + |Prlz, (0; c) 


The proof of Theorem is quite long. We shall prove its “Uniqueness” 
part in Subsection 12.4.3), and its “Existence and Stability” part in Subsection 
[Z5 


12.4.2 Preliminaries 


In this section, we present two preliminary results which will be used in the 
sequel. 


Lemma 12.10. Let p € (1,2], and J and K satisfy (IZM). Write 


A 2q 2q 
Ma) 5 |JOlroean + KO Lata y (12.47) 


Then, for each t € |0, T], the following three conclusions hold: 

1) If ug = ve = 0 in the equation (ZIO), then there exists am oper- 
ator U(-,t) € £(L (0; H); Ce ([t, T]; L (2; H))) such that the solution to 
(1240) can be represented as x2(-) = U(*,t)£o. Further, for any t € [0, T), 
£c E (Q; H) ande > 0, there is aô € (0, T—t) such that for any s € [t, t4-6], 
it holds that 

[UC t)E — Ul-, 8)E| Le (s,r;z2«(0::) < € (12.48) 

2) If £o = 0 and vg = 0 in the equation ([240), then there exists an 
operator V(-,t) € C(Lz (Q; L?(t,T; H)); Ce([t, T]; L?4(Q; H))) such that the 
solution to (IZ) can be represented as x2(-) = V(-,t)ua. 

3) If £o = 0 and u2 = 0 in the equation (240), then there exists an 
operator =(-,t) € L( La (Q; E? (t, T; £3)); Ce (ft, T]; £22 (02; H))) such that the 
solution to (ILZ.3U) can be represented as ro(-) = E(*,t)vs. 


Proof: We prove only the first conclusion. Define U(., t) as follows: 
U(,t): LE (N; H) > Crllt, T]; (0; H)), 
U(s, t)é2 = z5(s), Vsc [t, TJ, 


where z2(-) is the mild solution to (IEZZU) with uz = va = 0. 

By Proposition and Holder's inequality, and noting the fact that J € 
L4(0,T; L® (Q; £(H))) and K € L7*(0, T; L> (9; £(H; £9))), we obtain that 
for any s € [t, T], 
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IA 
e 
eS. 
A 
[VA] 
| 

3: 
Vass 
LM 
x 
































<e(elel + f Maacslenleste ye). 
t 








This, together with Gronwall's inequality, implies that 

[x2 C)lesqumz2«(0:2) € C|&lr2s (0:4): 
Hence, U(-, t) is a bounded linear operator from LF (2; H) to Ce(ft, T]; L” (2; 
H)) and U(.,t)€ solves the equation (IZÆ) with ug = v9 = 0. 


On the other hand, by the definition of U(-, t) and U(-, s), for each s € [t, T] 
and r € [s, T], we see that 


U(r,t)£ = S(r — t)£ + [ S(r —7)J(r) U(r, t)£dr 
+f S(r —7)K(r)U(r, t)EdW (v), 


and 


U(r,s)£ = S(r — s) + a S(r — T)J(r)U(r, s)Edr 


«f 5e- niu sawo). 


Hence, 














E|U(r, s)£ — U(r, te 
< CE| S(r — 3€ - Str - 0e" 


ER [ S(r — 7)J(r)(U(r. s)é — U(r, Dejar 
5 Lu S(r — 7) K(r) (U(r. 8)€ — U(r,)£) l 
+| fs S(s—T) U(r, t)£aW (r 7] 




















U(r, tear] ^ 








| 

T 
E: 

a 

T 

2 
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2q 
«x CE U(r, s)E — U(r, ie] dr 





S(r — s)£ — S(r od «cf M; k,g(T)E 

















2q 
E U(r, Qe] dr 





+e f M3 Ką(T) 
t 

















« CE U(r, s)E — U(r, Qe | ar 




















S(r — s)£ — S(r od, «e f. Mast 











ez 








+e f M; K (T)dr E 
t 


Then, by Gronwall’s inequality, we find that 














U(r, s)£ — U(r, pe < C(htr. s,t) i h(c, s, t)de), 





where 








a 














h(r,s,t) = E 

















S(r s)£ S(r tyé ef MJ, K a 
Further, it is easy to see that 


|é— S(s — t&|2 « cle 


By Lebesgue's dominated convergence theorem, we have 





lim E|£ — S(s — t)£[7? = 0. 


s—t+0 











Hence, there is a ô € (0, T — t) such that (2-48) holds for any s € [t,t + ô]. 
This completes the proof of Lemma ZIU. L1 


Remark 12.11. It is easy to see that, if (P(-), Q(-)) is a transposition solution 
to (IEZ3), then (P(-), QUO, QC) is a relaxed transposition solution to the same 
equation, where (Recall Lemma ZIA for U(-, t), V(-,t) and 5(-,t)) 


QOC t) F (Q()* EC, t) 








QU (£, u, v) = Q()UC HE+ QU) VC Aut 2 v, 

A " ‘ Q(*56.0 + ROGI 

QO (E, u,v) = QUC t€ QU)* V tu- A v, 
for any (£,u,v) € Hi. 3 it is unclear how to obtain a transposition 
solution ( (-), Q(- )) to (ZJ) by means of its relaxed transposition solution 
(P(-),Q QO, QC ?. It seems that this is possible (at least under some mild as- 
sumptions) but we cannot do it at this moment. 


For any t € [0, T] and A € p(A), consider the following two forward s- 
tochastic evolution equations: 
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eee T 3.49) 
n= d 
and 
l da} = (Ax + J)zàds + uzds + Ka5dW (s) + v2dW (s) in (t, T], (12.50) 
x3 (t) = 2. 


Here (£1, u1, v1) (resp. (£o,u2,v2)) is the same as that in ([LZ3U) (resp. 
(Z0)). We have the following result: 


Lemma 12.12. Under the assumptions in Lemma OZIO, the solutions of 


(12:23) and (L250) satisfy 
i lim z?(-) = zi() in Cg([t, T]; L?3 (2; H)), 


2 (12.51) 
lim z2(-) = za(-) in Op((t, T]; L’ (02; H)). 


A—oo 
Here x1(-) and x(-) are solutions of (L239) and (IEZ4U), respectively. 


Proof: Clearly, for any s € |t, T], it holds that 











Ble (s) — at (s) 


(S(s — t) — Sy(s 0)& f (S(s 0) - Sx(s~0))us(odo 








— FK 

















+ [ (86-00) - S = elt) 
«f St - tenue) = S6 — itat) a o) 


2q 


«f 66-0 - sosta 





Since A) is the Yosida approximation of A, one can find a positive constant 
C — C(A, T), independent of A, such that 


ISX J| ro tomen) S C- (12.52) 
Hence, 


2q 


n (S(s — e)J(o)m(e) — SA (s — o)J(a)a%(o))dol 


«ef 
t 
al 

t 











r 
Ù 




















(S(s — o) — SA(s — a)) Joni (o) do 
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s 2 
<ce| f (S(s — o) — — 
+CE f JG) RU Joi o) (0)| 770. 


It follows from Proposition BIA that 





4 


H 














2q 
do 
£2 


E] 2q 
+CE / o do 
t £9 

















(S(s — o) — SA(s — a)) K (o)zı (0) 

















Sx(s — e) K(e) (1o) — zì (0)) 








2q 
do 
£2 


2 
+CE [we ETC - aj (e) [, do. 


Hence, for t € s < T (Recall (ILZT2) for M; x 4(-)), 











(S(s — e) — Sals — e)) K (c)zx(o) 


























4 


H 


























)—at(s (s))[7 € A(A,s «cf M; x a (e)E|ai(o) (o)| do. 
t 


Here 











A(A, 8) = CE|(S(s — t) - Sx (s — t))& 7 


























+CE n (S —" 
«cg f \(s(e-0)- Sx(s - e) (0) [de 
«eg| [ (66-0 - 6- nent 




















4C ef |(S(s — 0) — Sy(s — 0)) K(o)a1(0) | do. 


By Gronwall’s inequality, it follows that 














Elx (s) — x} (s) f < AQ, s) «ef eC 6577) A(A, r)dr, t<s<T. 
t 


Since A) is the Yosida approximation of A, we see that Jim A(A,s) = 0, 
— oo 


which implies that 


1 A . — 
Jim [27 (-) — i 


1 ?lest mcos com) =N; 


This leads to the first equality in (Z5). The second equality in (2.51) can 
be proved similarly. This completes the proof of Lemma [LZ T2. LI 


12.4 Operator-Valued Backward Stochastic Evolution Equations 409 
12.4.3 Proof of the Uniqueness Results 


'This subsection is devoted to proving the uniqueness of both transposition 
solution and relaxed transposition solution to the equation (ZX). To begin 
with, let us prove the following lemma. 


Lemma 12.13. The following set 





RS 2 {r9(-) | z2(-) solves (LZ40) with t = 0, & = 0, ve = 0 
and some uz € LẸ(0, T; L” (9; H))} 





is dense in L2; L(0, T; H)). 
Proof: Let us prove Lemma [ I by contradiction. If this is not the case, 
then we could find a nonzero p € bee (Q;L3(0,T; H)) such that 














T 
: f (p,22),ds — 0, for any x E€ P. (12.53) 
0 
Let us consider the following H-valued backward stochastic evolution equa- 
tion: 
» = —A*ydt + (p— J*y — K*Y)dt - YaW(t) in [0, T), 
y(T) = 0. 





(12.54) 


The solution to (254) is understood in the transposition sense. By Theorem 
ELTG, the equation (254) admits a unique transposition solution (y(-), Y (-)) € 
Dg([0, T]; Lett (£2; HY) x LZ (0, T5 Lett (2; £9)). Hence, for any ¢1(-) € Ly (0,7; 
L?4(Q; H)) and ġ2(-) € L7 (2; L?(0, T; £3)), it holds that 














T 
-E f (shoe) 0) 08) - KUO) ts 


z R (12.55) 
=E | (ér(s)-uls)) gd +8 [ (209), Y 2) gts 
where z(-) solves 
l dz = (Az + ġı)dt + ó3dW (t), in (0,T], nes 
z(0) — 0. 





In particular, for any x2(-) solving (240) with t = 0, & = 0, ve = 0 and an 
arbitrarily given uo € L2(0, T; L?*(; H)), we choose z = x2, $1 = Jr2 + u2 
and $9 = Ka. By ([255), it follows that for all ua € L2(0, T; L74(Q; H)), 





























T T 
— J (x2(s), p(s)) yds = J (u2(s),y(s)) yds. (12.57) 
0 0 
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By (£257) and recalling (72253), we conclude that y(-) = 0. Hence, (ILZ-53]) is 
reduced to 


T T 
_ J (z(s), p(s) — K(s)*Y (s)) yds = f ($2(s), Y (s)) pods. (12.58) 
0 0 


Choosing @2(-) = 0 in (258) and (ILZ58), we obtain that for every ¢1(-) € 
LECO, T; L?*(0; H)), 






































E [ ( A S(s — a)¢1(a)do, p(s) — K(s)Y(s)) ds = 0. (12.59) 


H 


T 
! S(s — o)(p(s) — K(s)* Y (s))ds = 0, V c € [0, T]. (12.60) 


Then, for any given Ao € p( A) and c € [0, T], we have 


T 
f ee (le) — K(s)*Y (s))de 
(12.61) 
—(A9—A p S(s — a) (p(s) — K(s)* Y (s))ds = 0. 


Differentiating the equality (ILZGT) with respect to c, and noting (Z560), we 
see that 


f S(s — )(Xy — A)! (p(s) — K(s)"¥ (s))ds 
=0, Yoe (0,7). 


Therefore, 
e) = KC YQ. (12.62) 


By (£262), the equation (12.54) is reduced to 
m A* ydt — J*ydt + YaW (t) in [0, T), 





A (12.63) 


It is clear that the unique transposition to (253) is (y(-),Y(-)) = (0,0). 
Hence, by (2.62), we conclude that p(-) = 0, which is a contradiction. There- 
fore, E is dense in ToC L4(0, T; HY. o 
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Now we give the proof of Theorem ZZ. 

Proof of Theorem IZ]: Assume that (P(-), Q(-)) is another transposition 
solution to the equation (ZX). Then, by Definition LZA, it follows that, for 
any t € [0, T], 


























— T — 
0= E( (P(t) — P(t ))€1, E2) y + «f ((P(s) — P(s))ux(s), z2(s)) yds 


pu 





P(s))a1(s), ua(s)) yds 





at 








P(s)) K(s)zi(s), v2(s)) pods (12.64) 


LM 








P(s))vi(s), K(s)vo(s) + va (s)) gods 


T 








t Ae 
ef 
ef 
:[ (@ Q(s))v1(s), za (s)) pds 


4B [ (Gls) -Oel (9) its 

















where QU) and QC) are respectively the (pointwise defined) operators induced 


uniquely by Q(-) and Q(-). 
Choosing u; = v, = 0 and uz = ve = 0 in the equations (IZ39) and 
(1240), respectively, by ([264), we obtain that, for any t € [0, T], 


0 = E( (P(t) — P(t))&1,£2),, Ver, & e LS (9; H). 


Hence, we find that P(-) = P(-). By this, it is easy to see that (264) becomes 
the following 


























T —— 
a= J (Qs) — Q3) (5), #28) de 
i (12.65) 


T E PE 
«f ((Q(s) - Q(s))#1(s), v2(s)) pods, Vte [0,7]. 














Choosing t = 0, £3 = 0 and ve = 0 in the equation (24), we see that (20a) 
becomes 














T 
0= af ((Q(s) — Q(s))vi (s), €2(s)) yds. (12.66) 
t 
Fix any v1(-) € L2(0, T; L?*(0; C9)) and N > 0. Write 
et (59) = Xdggo - eco ors) 69) (59). 


Replacing v; in (Z250) by vj" and noting that both Q(-) and Q(-) are point- 
wisely defined, we obtain that 
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T E 
us jj (TO -00 Olr <N} (8) (Q(s) — Q(s)) vi (s), za (5)) yds. 


This, together with Lemma ZTA, yields that, for any vi() € L2(0,T; 
L?4(Q; £9)) and N > 0, 


Xt(io-eo aren} OO) = Q()viC) =0, ae. (t,w) € (0, T) x 2. 


Hence Q(-) = Q(-). This completes the proof of Theorem EZZ. oO 
Next, we prove the uniqueness result in Theorem ZJ. 
Proof of the “Uniqueness” Part in Theorem OZI: Assume that both 


P —,. =f) 20 
(P(), QO, QO) and (P(), ray 2 Q ) are two relaxed transposition solutions 
to the equation (ILZN). Then, by (1244), for any t € [0, T], it holds that 


























i T —— 
0=F a( (P(t) — P(t Da E2) y +E f ((P(s) — P(s))u1(s), 72(s)) yds 


DEL 





P(s))a1(s), ua(s)) yds 





PL 








P(s)) K(s)zi(s), v2(s)) pods (12.67) 


Nu 








T 





= Qo) (£2, us, v2)(8)) pods 

















pu = QU) (E1, ui, v) (s), ¥2(8)) pods. 





AG 
D 
" ef (n — P(s)) (K(s)zs(s) + v2(8))) pods 
ef 
J (@ 


Choosing uj = u2 = 0 and v, = v2 = 0 respectively in the test equations 
(T2339) and (1240), by (1257), we obtain that, for any t € [0, T], 


0 = E( (P(t) — P(t))&. £2) y, V &, & € L2 (0; H). 


Hence, we find that P(-) = P(-). By this, it is easy to see that (267) becomes 
that 














ES 


T alt) 
0=E J (vils), (Q — QO) (£s, us, v3) (s)) zods 














(12.68) 














F 
+ f (Q7 ~ QP) En u vi) (5), v2(5)) ds Vte [0,T]. 


t 


Choosing v2 = 0 in the test equation (Z240), we see that (258) becomes 














T AE P 
o-E f^ O G? -Q9)seo(),i. — (1260 
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Noting that vı is arbitrary in L2(0, T; L?*(62; £9)), we conclude from (ZY) 
a(t) ^ = 
that Q (-,-,0) = QU (., ., 0). Similarly, Q^ (.,.,0) = QM(-,-,0). Hence, 














T Att) AL 
o-& f (nt) (9^ - 09)0,09(9) ads 
t (12.70) 














T 
+e f Th — QM) (0,0, v1)(s), va(s)) pods. 


t 


= a(t) ^ 
Since g" (0, 0, p = Q (0, 0, ‘) and QO (0, 0, jg = QM (0, 0, BE from (20), 
we find that 














T A(t A 
0-22 J (vi (s), (Q E Q) (0,0, v3) (s)) pods, (12.71) 


EN a(t) A 
which implies that Q® (0,0, -) = Q(0,0,:) and Q (0,0,-) = ®© (0,0, ). 
Es a(t) A 
Hence Qo 4: 2 QU0(,.-)andQ (-,-,-) = QM(-,-,-). This completes the 
proof of the “Uniqueness” part in Theorem ZJ. Oo 


12.4.4 Well-Posedness Result for a Special Case 


This section is addressed to proving the following well-posedness result for the 
transposition solutions to the operator-valued backward stochastic evolution 
equation (28) with some special data Pr and F. 


Theorem 12.14. If p € (1,2], F € L&(0, T; L'(2; £3(H))), Pr € L^. (02; 
£Lo(H)) and J,K satisfy (Z9), then the equation (ZX) admits a unique 
transposition solution (P(-), Q(-)) with the following regularity: 

(PC. QC)) € De([0, T]; L^ (2; £2(H))) x L(0, T; L?(Q; £o(£5; H)). 


Furthermore, 


(P, Q)| Dp (to, 1» (2:62 (8))) x L2(0,T;L? (95 £2 (£9: H))) (12.72) 
< C(\Flz20,r;1(@:22(H))) + |Prlzz, , (ca um))- l 


Proof: We consider only the case that H is a real Hilbert space (The case 
of complex Hilbert spaces can be treated similarly). We divide the proof into 
several steps. 


Step 1. Define a family of operators (7 (t)}+>o on £2(H) as follows: 
T(t)O = S(t)OS*(t), VO € £»(H). 


We claim that (7 (t));»o is a Co-semigroup on £L2(H). Indeed, for any O € 
£L2(H) and nonnegative s and t, we have 
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T (t -- s)O = S(t + s)OS* (t + s) = S(t)S(s)OS" (s)S*(t) = TT (s)O. 


Hence, (7 (t))io is a semigroup on £2(H). Next, we choose an orthonormal 
basis D 1224 of H. For any O € £3(H) and t € [0, 00), 


2 
Jim |T(s)O - THO aan 


: * 2 * 
< [SO [zu lim, |S(s - £)OS* (s — t) - Ol, |" Olkan 
t+ 2(H) 


< |S(O [zur Tim X |S(s - )OS*(s - t)hi — Ohr, (12.73) 


oo 


: " 2 
< SHl lim $7 (sts — 1)OS* (s — t)h; — S(s — t)Ohi|, 
i=l 


+|S(s — t)Oh; — Ohi): 


For the first series in the right hand side of (2°73), we have 


Y |S(s— t)OS*(s — t)h; = S(s = t)Ohil;, 
i=l 
«CY |OS*(s - t£); — Oha| 7, = C|OS* (s - t) - Olkan 
i—1 
- C|(OS*(s - t) - 0) p - c (s(s-t0o* - O") hilir 
i=1 


For each i € N, 
|(S(s = t)o* — o*)nj[, < 2|S(s — t)O*h;|7, + |O" hil, < C|O* hi. 
It is clear that T 
2 JO*h;|7, = |O* Zan = lOlz,an- 
Hence, 


lim V ^ [S(s — t)OS* (s — t)h; — S(s — t)Ohi|;, 


s—tt ¢ 
i= 


: n * 2 
< QD |OS*(s — t)h; — Ohi| (12.74) 


oo 


x n |OS*(s — t)hi — Oh; = 


Similarly, it follows ia 
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c 2 
li — t)JOh; — Oh; ,, = 0. 12. 
= JO O F 0 (12.75) 
From (ZA)-A), we find that 
: 2 

lim |T(s)O — T(t)O| un —0, Vte [0,o0) and O € £s(H). 
Similarly, 

lim |7(s)O - T(£)O|z,(u, =0 Vt € (0,00) and O € £2 (HH). 

s—1- z 
Hence, (7 (t)}+>0 is à Co-semigroup on £L2(H). 


Step 2. Denote by A the infinitesimal generater of (7 (t)}:50. Then, .A* 
generates a Co-semigroup on £3(H). We consider the following £2(H)-valued 


backward stochastic evolution equation®: 


dP = —A* Pdt + f (t, P, A)dt + AdW in [0, T), 
(12.76) 
P(T) = Pr, 
where 
f(t, P, A)  -JP- PJ — K*PK —K*A-AK+F. (12.77) 


Note that £2(H) is a Hilbert space, and the Hilbert spaces £2(V;L2(H)) 
and L2(L3; H)(= £a(Ca(V; H); H)) are isomorphism. Hence, the composi- 
tion operator AK in (IZZ) makes sense, and the function f(-,-,-) satisfies 
Condition ÆI, in which the Hilbert space H is replaced by £2(H). By The- 
orem AI, the equation (2°78) admits one and only one transposition solu- 
tion (P, A) € Dg([0, T]; L?(Q; £C3(H))) x L2(0, T; L?(Q; C3(V; Lo(H))) (in the 
sense of Definition EILT3). Further, (P, A) satisfies 


|(P, A) Doe (0, T]; Le (0:22 (8) x L2(0,.T;L? Gc (V £202) (12.78) 
< C (|F| ra (o; Le (2:£2 (2) + Prize. (a£2())): | 


Denote by T(-) the tensor product of xı(-) and z2(-), i.e., T(-) = z1() & 
z2(-), where x; and z2 solve respectively (E239) and (240). Clearly, T(t, w) € 
£2(H). We shall derive below the stochastic evolution equation (valued in 
£2(H)) such that T(-) is the mild solution of this stochastic evolution equa- 
tion. 

For any A € p(A), define a family of operators (73(t))i9 on L2(H) as 
follows: 


5 Generally, in the equation (IZ) we do NOT have A*P = AP + PA* (Actu- 


ally, we do not need this equality for the definition of mild solution to (IZ 7ü)). 
Nevertheless, this equality does hold when A € £(H). 
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DO = SHOS), VO € Lo(H). 


By the result proved in Step 1, it follows that {7)(t)}i>0 is a Co-semigroup 
on £a3(H). Further, for any O € £3(H), we have 


7.(t)O — O S,(t)OS%(t) — O 








lim —— — — = lim 

1—0* t tot t 

= dim Sy (t)OS%(t) - SERO TOMUS Ue A qaa. 
t0 


Hence, the infinitesimal generater A) of (7T (t) iso is given as follows: 
AO = AO + 0A}, VO € £»(H). (12.79) 
Now, for any O € £Lo2(H), it holds that 
Jim. ITHO -AHO aan 
= lim | S(t)OS*(t) — S(t)OSS(t)|, ny 
< lim |S(t)OS"* (t) — SHOKO, (H) 


+ lim SHOSH — SX(t)OSS(t)] ,, (Hy 


Let us compute each term in the right hand side of the above inequality. First, 


[$(08* (t) - SHOK Olan < CJOS* (t) -oO lk ny 
: oo a (12.80) 
- c|s(t)O* — SX (t)O"* |j. ay — C 2; | (S(t) — SA (0))O*h[;,. 


Since " 
|(S(£) — SX(0)O*hi|, € C|O*hilz 
and T 
YO" hil = lOl, un < oo. 
i—1l 


by means of Lebesgue’s dominated theorem and ([LZEU), we find that 
á "T u 
Jim | S(t)OS* (t) — S(t)OSS(t)|,.. (gu =0. 
Similarly, we get that 
; * — u 
Jim [SŒOSX (t) — DOOZO aan zai 


Hence, 
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Jim ITO — Ty(t) =0, foranyt 0. (12.81) 
oo 


Ol pac) 


Write T^ = x} & x}, where x} and x} solve accordingly (Z379) and 
(C250). Let {e,,}°2, be an orthonormal basis of V. For any f,g € £9, denote 
by f @1,1 g the bounded bilinear functional on H defined by 


oo 


(f 81,1 9)( x,y) =) ( x, fej) y (gej, y Y) Yeye H. 
j=1 


Also, for any h € H, denote respectively by f 81,0 h and h 80,1 g the bounded 
linear operators from V to £(H), defined by 


(f @1oh)v=(fv)@h and  (h&oig)v — h & (gv), VvcV. 


Recall that any bounded linear operator on H can be viewed as a bounded 
bilinear functional on H, and vice versa. In what follows, we will also view 
x} Q x3, f $11 g and so on as bounded bilinear functionals on H. By Itó's 
formula, we have 


dT* = d(x? & x2) 
= (dz) & x2 + zt Q d(z2) + (dx?) & d(z2) 
= [Gb 9a] @atds+at® [Ao + Jad] ds 


ip [u Q TÀ + 1? Q u2 + (Ka?) Gi (Kx) + (Kx) eile (12.82) 


+U1 81,1 (Kz3) T1431 va ds + (Kad) 81,0 rÀ 





tat 80,1 (Kx) + V1 1,0 rÀ + rÀ 80,1 va dW (s), 
On the other hand, for any h € H, we find 
((Axz1) & 13) (h) = (h, Axx?) yr? = (ASA, zt) 423 = (21 9 z2) ATA. 


Thus, 
(Axr?) @ 2} = T*A}. (12.83) 


Similarly, we have the following equalities: 
a} ® (A322) = A T>, 
(J£?) 8 z2 +2} 8 (Jz2) = TòJ* + JIT, 
(Ka?) &11 (Kz2) = KT^K*, 
(Kx?) 91,0 22 + z? 80,1 (Kz2) = T^K* + KT?. 


(12.84) 


By (ZÆ), (I-82)- (UA), we see that TÀ solves the following equation: 
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dT^ = AX T?ds + o^ds + 8^dW (s) in (t, T], " 
[m = 8, idi 
where 
^o JT? + T^J* +u Q z2 + 22 8 uo + K T^ K* 
+(Ke}) 1,1 v2 + v1 814 (K22) vi 814 v2, (12.86) 
f^ = KT?^ + T^K* vi 81,0 22 + 2} 804 v3. 
Hence, for any s € [t, T], 


T^(s) = Ta(s — t)(& & £2) + f Th(7 — t)o? (r)dr 
! (12.87) 


" f Thr — t)6^(T)dW (7). 
A 
We claim that 
Jim IT^() — T()lesquryzeqecao» — 6 — Vte[0,T]. (12.88) 


Indeed, for any s € [t, T], we have 
2 
[T^(s) — T(5)/2,u = 2 |T^(s)h — T(s)hil i 


|a a (8) ro (5) — (hi, mi (5) rs (8) [7 


ei 


" 
ll 
m 


[lhi £) 5)) rod 5) — (hi, £) (8)) nro (8) | 7 


I 


ll 
am 


<2 


vu 


427 [a (8) na2(5) — (hi, a ()) noo (3) [;; 


I 


ll 
un 


2 X 2 
< 2|23(s) -nils 2. | (hi, 22 (8) n 
2 
+2|x9(s) eX Y hi, £? (s )— zı(s al 
2 2 
ze S JP? Ja) s) — z»(s Jl + 2|xa( s). lx (s) — 21(s)|;,- 
This, together Lemma [LZ TZ, implies that (288) holds. Write 
a = JT + TJ* + Q T2 + £1 Q u2 + KTK* 
+(Kz1) 813 v2 + v1 811 (Kz2) + v1 81,1 v2, (12.89) 
B = KT + TK* + vı 81,0 £2 + z1 99,1 V2. 
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Similar to the proof of (2238), we have 


Jim lo^) — o(-)u»Ir2(r;ra(0;£2(2)) = 9: 
Min (12.90) 
Jim 18^) — BOLG, rine (eses(vics i) = 9- 
By (231), using (C238), (IEZUU) and Proposition BT, one can show that, 
for any t € [0, T], it holds that 


f Jtr Da ies f Fraien 


i T(t — t)8^(r)dW (7) > f T(r — t)B(r)dW (7) (12.91) 


in Op((t, T]; L2 (£2; £2(H))), 


as À — oo. Hence, T(-) is the (unique) mild solution to the following stochastic 
evolution equation (valued in £2(H)): 


dT(s) = AT(s)ds + ads + 8dW (s) in (t, T], 
(12.92) 


T(t) = & 8 &. 


Step 3. Since (P, A) solves (IZA) in the transposition sense and by 
(2.92), it follows that 


























T 
ECT(T), Pr) e an — ef (T(s), f(s, P(s), A(8))) c ands 


























T 
= E(& ® &, Pt) ocx + Bf (als), P()) o ands (12.93) 














T 
+ f (B(s), A(5)) p, cv cs un d 


By (ZT) and recalling that T(-) = z1(-) Q z2(-), we find that 














T 
D J (Ts), f(s, P(s), 4(3))) ands 


(12.94) 














T 
= Bf (( — J(s)*P(s) - P(s)J(s) — K* (s)P(s)K(s) 
—K*(s)A(s) — A(s)K(s) + F(s))a1(s), xa (s)) yds. 


Further, by the first equality in (2.39), we have 














T 
Bf (a(s), P(s)) z, (uds 
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T T 
-E f (P(s)z1 (8), J(s)z2(8)} yds +E f Pea 2508) de 




















T T 
+ f (P(s)un(s),22(8)) s+ | (P(s)x1(s),t2(s)),,ds (12.95) 








T 
4 f (K*(s)P(s)K(s)x1(5), x2(s)} yds 








T 
ES J (P(s)K(s)a1(s), v2(8)) pods 





























T T 
4 J (P(s)ui (5), K (s)mo (5) pods + Ji (P(s)m (5), 02(8)) pods. 


Further, by Proposition [LZ A(-) induces a bounded linear operator Q(-) € 
L2(L9; H) and a bounded linear operator Q(-) € £2(H; £9) satisfying (235) 
and pointwise. Hence, 


oo 


(vi C) 81,0 2). A(-)) £x(V;£a(H)) =D -) 81,0 £2( Neg, AQes) ean 
= J ((v10)e;) 8 z2(),4 i) cs un) = (4 (Je;),22()) n 


e. 
Il 
H 
un 


(Q(-)(e; ® ((6;)) 229) =X (e; ® (vi (9e) Q(-)*#2(-)) co 


j= 


Il 
IMs 


((Q('22())e5, (365) y = (QU)'22, v) c = (Q()ui ) 22()) y 


M: 


and 
(210) 8a 20). 4) z vica ap) 7 2. (r1 O) 80,1 2 ))eg. A65) cr; 
= 5 (x1(-) e (v2(-)ej;), A = L(A ej) zıl ) va(Jes)g 


a. 
Il 
m 


(QO (e; 9 ()), vales) g = (Orl) v9 )) s 


M: 


e. 
Il 
MN 


Thus, by the second equality in (T2389), we have 


T 
J (B5). A(5)) p. cv c nds 
T 
-E f (KC (5) A()as (8), 2 (5)) yds + E f (A(s) K (s)a (5), xa (5)) yds 
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T T 
+ f (Q(s)xn(s),02(s)) ds +E f (Q(s)21(s), v2(s)) pods. (12.96) 


























By (ILZ:93)- (ILZ:9G), it follows that (P(-), Q(-)) satisfies (Z3) and thus 
is a transposition solution of ([LZN) due to Definition ZH. The uniqueness 
of which follows theorem ZZ. As a result, the proof for Theorem [214 is 
completed . LI 


12.4.5 Proof of the Existence and Stability for the General Case 


This subsection is devoted to proving the existence and stability result (for 
the equation (IZX) in the sense of relaxed transposition solution) in Theorem 
EA. 


Proof of the “Existence and Stability” part in Theorem EZI: We consider 
only the case that H is a real Hilbert space (The case of complex Hilbert 
spaces can be treated similarly). The proof is divided into several steps. 


Step 1. In this step, we introduce a suitable approximation to the equation 


Let {h, }92, be an orthonormal basis of H and {I,}°2, be the standard 
projection N from H onto its subspace span {h1, h2,- -- , hn}, that is, 
Int = 5 ik for any z = ue € H. Write 

i—l {=l 
F” =I,FIn, PRLIWPRD. (12.97) 


Obviously, F” € Lp(0,T; LP (2; La(H))), Py € LE (0; La(H)). Furthermore, 


|F" | LLO, T; Le (2; + LPF ro. (mc) 
< |F” t1 0,T;Le(2;£2())) + [PE |12 (@:£2(H)) (12.98) 
< C(IFIzito;rizo oca + FPrlzs, eean) 


Here and henceforth C denotes a generic constant, independent of n. 
Let us consider the following £2(H)-valued backward stochastic evolution 
equation: 





dP” = —(A* + J*)P"dt — P"(A+ J)dt — K* P" Kdt 
—(K*Q"4+ Q" K)dt + F"dt + Q"dW(t) in [0, T), (12.99) 
P"(T) = P}. 
Clearly, for each n € N, (ZJ) can be regarded as an approximation of the 


equation ([LZN). In the rest of the proof, we shall construct the desired solution 
to the equation (IZA) by means of the solution to (299). 
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According to Theorem [LZ.14, the equation ([[LZ.9J) admits one and only 
one transposition solution 


(12.100) 
€ De([0, T]; L^ (2; C5 (H))) x Eg(0, T; L? (0; L(V; L2(H))), 


in the sense of Definition IZE. Hence, for any t € [0, T], £1,£2 € Lp H), 
ui(),u»() € L(t, T; L?*(2; H)) and v(-),va(-) € L2(t, T; L?*(05 £9), it 
holds that 


























T 
E(PPa (T), zo (T)) 4 — f (F^ (s)z1 (5), £2(8)} „ds 


























T 
= E(P"(t)E1, E2) y + ef (P"(s)ua(s), x(s)) yds (12.101) 




















T T 
4E a f (P" (s)ax (s), u2(s)) ds + J (P" (s) K (s)m (s), vo(s)) pods 








T 
4E f (P" (s)ui(s), K(s)z2(85) + v2(s)) pods 





























T S m 
dE J (Q" (s)ui (s), v2 (s)) yds + J (Q" (s)m (5), vo(5)) gods. 


Here, Q” (s) is the operator induced by Q"(s), and z(-)(resp. za(-)) solves 
(1239) (resp. (ILZ-30)). As we shall see below, the variational equality (ZIUN) 
can be viewed as an approximation of (245). 


Step 2. In this step, we take n — oo in (2-101). For this purpose, we need 
to establish some a priori estimates for P”(-) an Q"(-) (in suitable sense). 

Let uy = vı = 0 in (22239) and u2 = v9 = 0 in (ZÆ). By (Z), we 
obtain that, for any t € [0,7] (Recall Lemma ZII for U(., -)), 


























T 
E( Pr U(T, t)£1, U(T, Db — af (F"(s)U(s, t)&, U(s, t)&2) yds 

t 
= E(P" (t)&, £2) y V £1, €) € LE (Q; H). (12.102) 


Hence, 


























T 
E(U*(T, t) PRU(T, 6 — J U* (s, t)F"(s)U(s,t)&ids, £2) 














= E(P"^(t)&, £2) g> V £&,£&) € L (0; H). 
This leads to 














B(U* (Tt) PRU(T, 96 - [ MELLE Mm 


—-P'(t), as,.Vte[0 T], & e LA (2; H). 
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By (ZIX) and (ILL IU2), it follows that 
E(P” (06.62) y 
= C(IPrlzs. (acc) + |[Flzitorr; z»(9:c(2))) (12.104) 














"s ll p22 (Q;H) l&2| 222 (9,11): 


Here and henceforth C denotes a generic constant, independent of n and t. 
For P"(t), we can find a £i, € L 2 0 H) with Itn] p28 (Qu) = 1 such that 


1 


| P" (t)E1,n| = 3 VP" Oro. ean 


12.105 
T (12.105) 


Moreover, we can find a zn € LE (Q; H) with l&2.n] 128 (Q;u) = 1 such that 











E(P ^ (061,5, 625) y s g Jw] pu s (12.106) 
2 (2H) 





From (IZ TUA)-(IIZ-TUG), we obtain that, for all n € N, 


|P" ree (o. zo (0: (2) daai 
< C(IPrlze. (mea) + VFlzionzecocany): 


By Theorem Z, one can find P € £oa( E (0, T; LORD HS GELT 
L7 (Q; H))) such that 
|P] 


E(L2(0,T;L2«(QH));L2(0,T;L7«*X (Q;H))) (12.108) 


< C([Prlzz. (acum) Florae coscon»): 


and a subsequence [ni yes , C (n)?2., so that, for any u, € L2(0, T; L4(62; 
H)), 





(w)- lim P™ u, = Pu, in L2(0, T; L2«^3 (Q2; H)). (12.109) 


k—oo 
Further, by (Z107) and Theorem Z7H, for each fixed t € [0, T), there ex- 


2q 
ist an R® € EU (Q; H); LET (Q; H)) and a subsequence mE C 


n yoo. , (Generally speaking, each n 


€ € L' (Q3; H), 





may depend on f£) such that, for all 


PELD 
(w)- lim Pr ()€= RE in LÆT (Q; H). (12.110) 
— o0 
Next, let uy = vı = 0 and € = 0, ug = 0 in (IZ39) and (ZÆ), respec- 
tively. From (Z0), we find that 
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T ~ 
af (Q" (s)U(s, t)€1, v2(s)) pods 


t 























T 
= E(P22\(T),22(T))  —E | (F"(s)a(s), 22(s)) „ds 

















2 


T 
-E f (P" (s) K (s)231 (s), v2(s)) pods. 


'This implies that 














T 
ef (Q" (s)U(s, t)&1, va(s)) pods 
t 
< C(IPrlzs, (ecan) T |F| 1 (0,T;Lr(2;£(8)))) (12.111) 
X [El rs (or l2 rg qms (c9) 
V£&à € L3 (0; H), v, € L(t, T; L742; £9)). 


We define two operators pr and QU from LE (a; H) to L£(t, T; LAA (Q; 
£9)) as follows (Recall Lemma [2210 for U(-,-)): 
Me = FUE. a 
PM VEE LZ (Q; H). 
16-Q"()'U(.t)6, 


It is easy to see that Q^, Qt € £(L99 ! (Q; H); L(t, T; L9: (0; £9))). By 
(Z), it follows that 





nyt 
QI | 2q Eriga s geet -£9 
£(L32 (0: Hi L (6T; L 2471 (2;£3))) (12.112) 
< C(|\Prizz, (acu) + IF| za to rio (0:60) 
Similarly, 
|Qr | £(L23 (0;H); LA(tT;L 71 T(2;£$))) (12.113) 


< C(IPrlzs. (acum) + Flase.rize(acun)))- 


By Lemma ELGl, for each t, there exist two bounded linear operators QÉ 
24; q 

and Qt, from Dx: H) to LÆT (t, T; L2 (N; £9)), and a subsequence 

meL, c (n V2. such that, for any € € L3 (2; H), 








NE 4 
(w)- Jum Qj* te = Que in LÈ, T; L9«3 (2; £9), 

Ame te G " (12.114) 
(w)lim Qi" "€=Qié in LÈ(t, T; LA (Q; £2)). 
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In view of (IIZIT2)-(ILZTL3), we have 
t 
atl, 


2q 
LYS (Q;Hy Lg (t,T;L 9471 (5£9))) 


[Qt | (12.115) 


LCL (3H L3 (GT LIFT (05£9))) 
< C(IPrlzs, (acu) F |F] t1 (0,T;Lr (2; ())))- 


Further, we choose £4 = 0, vı = 0 in (IEZ39J) and £2 = 0, u2 = 0 in (20). 
From (Z0), we obtain that 


























T 
E( Pas (T), £2(T)} y — f ( F” (s)a3 (s), £2(5)} „ds 


























T T 
-E 1 (P" (s)us (8), £2(8)} yds +E | (P"(s)K(s)a1(s), va(5)) pods 














T ~ 
+ f (Q" (s)x1 (s), 02(8)) pods. (12.116) 


2q 
1 


Define an operator Q3* from L2(t, T; L?4(Q; H)) to L2(t, T; Lz- 
follows (Recall Lemma ZI for V (., -)): 





(2; £3)) as 


(Qz*u))) = QOV (tuz, Vus € LẸ(t, T; L^ (0; H)). 


From (Z0), we get that 














T 
J ((Q3"u1) (s), vo ()) pads 


























y 
= E(Ppai(T), £2(T)) y — J (F" (s)ai (s), x2(s)) yds (12.117) 








= 




















T T 
_E J (P^ (sju (8), ea (s) ds — E | (P"(s)K(s)1(s),v2(s)) gods 


< C(IPrlzz. (ocan) 


AF] zi o, Loto: )) |ui [r2 (m; 12« (9,2) l?2| r2 (24 (9:62) 
V u1 € LÈ(t, T; L” (Q; H), w € EEG, T; L” (Q; L9)). 


From (2117), we see that 
IQ"] 24 


L(L2(t,T;L24(2;H));L2(t,7;L 24-1 (Q;£3))) 





(12.118) 
< C(IPrlze. (a,cun) + Floz0,7;19(2,c0)))- 


Also, we define a linear operator Qv from Ls(5 T; L^9(0: Hy to L(t, T; 
L**^1(0; £3) by 


426 12 Pontryagin- Type Stochastic Maximum Principle and Beyond 
(Q*uj)() = Q"()*V(,t)us Vus € D2(t, T; L” (N; H)). 
By a similar argument to derive the inequality (2118), we find that 


Qt E 
| à loss reta ere (2;£3))) (12.119) 


< C(IPrlzo. (2e)  [Flzitoizo(ocun»)- 


By Lemma ZEI, for each t, there exist two bounded linear operators Q5 
a 2q 
and Q5 from L2(t, T; L74(Q; H)) to Lz(t, T; L771 (Q; £9)) and a subsequence 


(n? ye | C (n 9o , such that, for all uz € L2(t, T; L4(62; H)), 


n=1 





n (9 q 
(w)- jim Q" "us = Q5us in Z2(5,T; Lue (2; £9)), 
—oo 





" (12.120) 
Zn EN š -24 
(w)- lim Q3* "uz — Qius in LE( T; Lov (0: £9)). 
In terms of (ZIX) and (£2119), we obtain that 
t 
(O s runc rcs (2;£3))) 
+|Q5| (12.121) 


£(L3(t,75L24(2;H))sL3(t,TsL 24-1 (9,69) 
< C(IPrlzs. (acan) + |Flazo,r:2(@,c09)))- 


Now, we choose £1 = 0 and u, = 0 in (1239), and 2 = 0 and uz = 0 in 
(1240). From (C2100), we obtain that 


























T 
E(Pr2(T),¢2(T))  — J (F" (s)g; (5), €2(s)) yds 














T 
= J (P" (s) K (s) (s), va(s)) zo ds (12.122) 








T 
4E f (P^ (s)n (s), K(s)z2(5) + va(s)) pods 


























T cape 
4E f (Q"(s)vs(), 22(3)) ds +E f (Q”(s)z1 (s), va (s) gods- 


We define a bilinear functional B,4(-,-) on L2(t,T; L74(Q;L9)) x L2(t, T; 
L? (9; C9)) as follows: 

















T 
By t(v1, v2) = Bf (Q" (s)vi (s), v2 (s)) yds 


(12.123) 














T ~ 
+ f (Q" (s)m3 (s), va(s)) pods, 


V v1, v2 € Let, T: L720; £3)). 
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It is easy to check that B,4(-,-) is a bounded bilinear functional. From 
(12122), it follows that 


B, (M1, v2) 


(1) 


1 
=E(P;* a) 


zı(T),2a(T)}_ - E A (Fn (s)r1(s),22(s)) ds 


























(12.124) 








z [ (P? ())K()a (9), va(5)) . de 


t 


sf (PE (s ) (5) K(s)r2(s) + v2(s)) „ds. 


2 














It is easy to show that 




















lim E(PR* a; (T), £2(T)} , = E(Pras(T), zo (T)) y, 


k—oo 














lim 
k—oo 








: T 
ne ( (s), a2(s)) yds = J (F(s)a1(s),#2(s)) ds, 











k—oo 





=E 





Js (5) v2(5)} gods, 











lim 
k—oo 


z p^ (P(G)oi (s), K(s)22(s) + vo(s)) pads, 


t 





Pa 

lim TEC K(s)ai(s), v2(8)) pods 
[€ 
fi 


(Pre ( vi(s), K(s)ro(s) + va(s)) pods 














where zı (resp. 2) solves the equation (ILL3J) (resp. (ILZ4U)) with £1 = 0 
and u1 = 0 (resp. £j = 0 and ua = 0). This, together with (ZIZ), implies 
that 


t Aq 
B vi, v2)= lim B,c (v1, vz) 


























T 
= E(Przi(T), x2(T)} y — f (F(s)zı(s), x2(s)} yds 
(12.125) 








T 
= f (P(s) K (s)m (s), v2(s)) pods 














T 
E J (P(s)v1(s), K(s)xo(s) + v2(8)) pods. 


Noting that the solution of (239) (with £j = 0 and u1 = 0) satisfies 
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x1(s) = 1 S(s — T)J(T)xı(T)dr + f S(s — T)K(T)xı(T)dr 


«f S(s — rT)v(7)dW (T), 
t 
by means of Proposition and Gronwall's inequality, we conclude that 


lxi rg (t,7;£24(2;H)) € Clvilrzqrn2«(0:69)- (12.126) 


Similarly, 
Ixo| rea, Tr; € Clvalr2(e,7;224(.2;£9))- (12.127) 


Combining (IEZIZ3), (C212), (127) and (ILZTUS), we obtain that 
t 
[B' (v1, v2)| € C(|Prize, (acu) + |F| ri (o rz (2:21) 
x [vil 22 (4,7;220(0;09)) Val r2 7; 12« (0:69) 


Hence, B'(,-) is a bounded bilinear functional on L2(t,T; L?47(Q;L3))x 
Lg(t,T; L74(Q; £9)). Now, for any fixed v9 € L2(t, T; L74(Q; £9)), it is easy 
to see that B'(-, v3) is a bounded linear functional on L2(t, T; L74(Q; C9)). 


2q 


Therefore, by Theorem Z-Z3, we can find a unique 0; € L2(t, T; L2«-1 (62; C9)) 
such that, for all v) € L2(t, T; L74(Q; £3)), 








t | /x 
B‘ (vı, v2) = 18) a "ms 
Define an operator Qt from L2(t, T; L?2(62; £9)) to D2(t, T; LZ (NQ; £9) as 
follows: n 
Qi vi = &. 
From the uniqueness of 01, it is clear that Qi is well-defined. Further, 


[91] 


At 
30 one 





q = 2q 
-1(0:;c9)) Le (t,T;L 24-7 (2;£3)) 


(12.128) 
E C(IPrlzs. (2ean) + [F] rxto zo (oco) Wil narro (0:2) 


'This shows that Qt is a bounded operator. For any o, 8 € R and vo, v3, v4 € 
Lg(t, T; L?*(02; £3), 


(Q5 (ovs + Buva), v2) 2 


a 
L$(t,T;L?2-1(0;£8)), Le(t,T;L79(2;L£9)) 


= Bt (avs + Bv4, v3) = aB* (v3, v2) + GB" (v4, v2), 





which indicates that 


Qi(ovs + Bv4) = aQlvs + BQ5u,. 
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Hence, Q$ is a bounded linear operator from L2(t, T; L24(Q;£3)) to L2(t, T; 
2q A 

L 74-1 (2; £9)). Put Qi = $Q5. Then, for any v1, v2 € L2(t, T; L?2(62; £9)), it 

holds that 


B‘ (v1, v2) = (Q$vi, v2) 





2q 
Lg (t,T;L 74-7 (03£2)), Lg (6,T;L?2(0:£2)) 


+(v1, (QA) va) 2q 


L2(t,T;L24(Q;£9)), L2(t,T;L 24-1 (2;£3)) 


(12.129) 





Here, by Theorem 2.73, (Qi) is a bounded linear operator from L2(t, T; 
2q 


Luw-c(Qip9y* = L(t, T; LQ; r9) to L(t, TLU(rDy = LET; 
LZ (Q2; £9)). It follows from (128) that 


IQs| 





E (L2 (tT; L22(0;£9)); L2 (4L 74^ (2:£3))) (12.130) 


< C(|Prlzz. (eeu) + Floro (acc): 


For any t € [0, T], we define two operators Q and Q® on EA (Q; H) x 
LA (t,T; L79(Q; H)) x L2(t, T; L?*(62; £9)) as follows: 


QU (E,u,v) = QIE + Qu Qv, 
QO (£, u, v) = Qu "dr Qiu + (Qi)'v, 
V(£,u,v) € LE (0: H) x Dg(t, T; L (9; H)) x LEl, T; LP (0: £9). 
(12.131) 
Thanks to the definition of Qf, Q5 and Q5 (resp. Qf, Qi and (08) Y. we 
find that Q9 (.,.,-) (resp. QU C. M is a bounded linear operator from 
LA (0; H) LRG Ty L0; H)) x LB(t,T; *(0; £9)) to L}(t, T; Ln (40; 
£3)) and Q9 (0,0, )* = Q® (0,0, -). 
For any t € [0, T], by means of (2101), (2109), (2110), (2114), 


(IETZU), (T2123), (CLIA), (C9) and (IEZT3I)), we see that, for all (£1, ui, 
v1), (£2, ua, v2) € LZ (05 H) x LÈ(t, T; L?4(Q; H)) x Let, T; L?4(Q; £3), 





























T 
E(Prai(T), z2(T)) y — ef (F(s)ai (5), x2(s)} yds 


























T 
= E(R E, E2) y + J (P(s)ui (s), za(s)) yds (12.132) 




















T T 
+E | (PG) ni) uds E | (PGOKG) GJ, m) ads 








T 
4 J (P(s)v1(s), K(s)x2(s) + v2(8)) pods 

















T A 
Bis af (v1(s), QU (E2, us, va) (s)) pods 


t 
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T 
+e f (Q (E1, ui, vi) (s), va(s)) pods. 
t 
Step 3. In this step, we shall show that P(-) € Dr,,([0, T]; LP (42; £C(H))) 
(recall (L241) for the definition of this space) and 
P(t) - RO, ae. t € [0,7]. (12.133) 


Similar to the proof of (213), by (T2132), one can show that 














E(U*(Z, t)PrU(T, tf — J ie a | e (12.134) 


-RO&, as., VtE [0,7], & e LE (0; H). 


Now we show that ROE € Ds((t, T]; L»*1 (9; H)) for any £ € L (9; H). 
By (2-100), it remains to show that 


im. [ROE — P^()€| =0. (12.135) 


2q 
LẸ (t, T;L 24-1 (Q;H)) 


For this purpose, by (ILZ-IU3) and (IZI34), for any 7 € [t, T], we see that 





m 


2q 
ROE — P” (r) Ft 

















2q 
34—11 
H 














T 
« CE f U*(s, 7) (F(s) — Fa(s))U(s, r)éds 


2q 
2q—1 


U*(T, T)(Pr — Pp)U(T, T)É » 











+CE 











By the first conclusion in Lemma (2.10, we deduce that for any &1 > 0, there 
is a 0; > 0 so that for all r € [t, Tl and T <o € 74+ 61, 





2q 
E[U(r, 7)£ — U(r,e)£|? < ex, V r € [o, T]. (12.136) 











Now, we choose a monotonically increasing sequence (7;1^, C [0, T] for Ny 
being sufficiently large such that 7;41 — T; < 61 with 7; = t and rw, = T, and 
that 


de 


i 


2a 
2q—1 


F(s) Puan)? ds) <£, forall i = 1,---,Nı— 1. (12.137) 

















For any r(7;, Ti41], recalling F” = I4, FI, we conclude that 





2q 
" 24—1 
H 

















T 
f U*(s, T) (F(s) — F"(s))U(s, T)éds 


2q 
T 


2q— 
H 











< CE 








T 
n U* (s, r)(F(s) — F^(s))U(s, r;)&ds 
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4CE Ti U* (5, T) (F(s) u F^ (s))U(s, r;)£ds = (12.138) 
T .24. 
+CE| | | U*(s,r)(F(s) — F"(s))(U(s, ri) — U(s, ))&ds = 
T 2 
<C | E|(F(s)— F"(s)U(s n)" ds 





























— 


+¢( f  BIF()Bun)*ds) 


i 














+C max E 
sE[r,T] 








(U(s, 7;) — U(s, TYE :3 





By the choice of F”, there is an integer N2(£1) > 0 so that for all n > Nz and 
jede, Nd 


T 
ri : 
: 


i 











(F(s) = F”(s))U(s, THE 





2q 
"ds < e. (12.139) 
H 








By (IEZE38)- (ILZ-L39), we conclude that for all n > No and 7 € [t, T], 


2q 
2q 


T EN 
f U* (s, r)(F(s) — F"(s))U(s, r)gds| " < C18. (12.140) 





n 














Here the constant Cı is independent of £1, n and m. Similarly, there is an 
integer N3(€1) > 0 such that for every n > N3, 





m 











U*(T, 7)(Pr — PR)U(T, nad < Ge, (12.141) 





for a constant C3 which is independent of £1, n and T. Now for any e€ > 0, let 
. Then, 





us choose £4 = Zac 
1 2 





"y 











ROE- "(e| zs <e — Vn > max(Na(e), Na(e)), V € [t T]. 





Therefore, we obtain the desired result (2135). 

To show (2133), for any 0 € tı < t» < T and m,m € LZ (f; H), 
we choose £1 = 7 and uj = vı = 0 in the equation (12:39), and £9 = 0, 
u2(-) = Xati n and v2 = 0 in the equation (2-40). By (2132) and recalling 
the definition of the evolution operator U(.,-) (in Lemma [LZ TU), we see that 

















1 ie 
af (P(s)U(s, t1), n2) yds (12.142) 
to—ti Je, 


T 
= E(Pru(T, t1)m,©2,t2(T)) y = af (F(s)U(s, t1)m, 22, (s) yds, 


tı 
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where 2z2,,(-) stands for the solution to the equation (ILZ4U) with the above 
choice of £o, uz and v». It is clear that 





Je T)*2.44(T)dT + [ se odT 
ar 


©2,t9( «fs S(s — T) K(r)z2. 4, (Cr)aW (T), s € [t1, t2], (12.143) 


U(s, t2)22,4, (t2), sc [to, T]. 


Then, by Proposition BIA, we see that for all s € [t1, t2] (Recall (L247) for 
M, aC); 

#) 

Fa 












































2 li : 2 ; 
(S) < e( | MJ k,q(7)E |2,t2(r)| d +E 
ti 
By Gronwall’s inequality, it follows that 
l2, C) ng tas L20 (0:8) < Clialzis (Q;H) (12.144) 


where the constant C is independent of t2. On the other hand, by (2143), 
we have 














Elo t3 (13) — nol 


: 2 : 
«ef Mj a (r)E|zos (7) |] dT +E 
tı 





























m S(to — T)N2dT — m|). 





oh 


This, together with (2144), implies that 

















l. 


t2 
t 
[| St mmaee-n[ 








= 0. 











Blæs t (62) ^ m | Ec 








lim lim 
t2—>tı +0 t2—>tı +0 





Therefore, for any s € |t2, T], 











: ~ 2q 
* UM E|U(s, t2)22,t2(t2) — U(s, ti) n2| 5; 














A x 2q 
<C lim, | (E|U(s,t2)9,40(t2) — U(s,t2)na| z 














- 2 
+E |U(s, t2)n2 = U(s,ti)ml x) 





























. r 2q ^ 2q 
EC, lim, ( E|22.1, (t2) — n| y + E|U(s, t2)n» — U(s,ti)ml 9) 


= 0. 
Hence, 


„im 22, to(8) = U(s,ti)go in i (2; H), Vs€ [t2,T]. (12.145) 
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By (ZIM) and (2145), we conclude that 














"m ( : (PrU(T, ta)M 2245 (T)g 














T 
-e f (F(S)U(s,t5)m, 22,,(5)) 45) (12.146) 


ti 


























T 
= E(PrU(T, ti)m, U(T, t1)2) p — af (F(s)U(s, t1)m, U(s, t1)n2) yds. 


ti 


Choosing €; = rj and u1 = v, = 0 in (239), and £ = Nz and uz = v = 0 in 
(1240), by (12132), we find that 




















E(RU Day, 12) y = E(PrU(T, tym, U(T, ti)m2) y 








(12.147) 














T 
-e | (F(s)U(s, t1)m, U(s, t1)n2} yds. 


tà 


Combining (2142), (Z140) and (IZET2), we obtain that 





























t2 
f (P(s)U(s,t1)m 2) yds = E(RU?,m3) ,- (12.148) 


lim 
1321140 tə — tı ty 


On the other hand, by Lemma ÆTTA, there is a monotonically decreasing se- 
quence {4 Joo, with i? > tı for every n, such that for a.e. tı € [0, T), 


o) 
lim 4m) 4 Ef 
HPontot,’ — ti Jt 


This, together with ([2.148), implies that 


























(P(s)U(s, ti)m, m2) yds = B(P(ti)m, M2) g 


























E( RUD m n2) y = E(P(t1)m,12) y; for a.e. tı € [0, T). 


Since 7 and 7 are arbitrary elements in LE. (42; H), we conclude (IZ 33). 
By (C2132) and (C2033), we see that (P(-), QU, QO) satisfies (245). 
Hence, (P(), QO,QO) is a relaxed transposition solution to (IL), and by 


(LZ. 108), Ca), (2-121), (ILZ.I3U) and (2131), it satisfies the estimate 
(1246). This completes the proof of Theorem Z9. Li 


12.4.6 A Regularity Result 


In this subsection, we shall derive a regularity result for relaxed transposition 
solutions to the equation (ILZ:N), which will play a key role in the proof of the 
general Pontryagin-type stochastic maximum principle in Section ZA. 

Let {Am} be a sequence of partitions of [0, T], that is, 
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Am = ur 





axo oim and 0= (y «(ee <im=T} 


such that Am C Am4i and |A,,| 2 maxoci<cm—1(t™ — ti) > 0 as m > oo. 
Recall that {e;,}?2., is an orthonormal basis of V. For m,n € N, we introduce 
the following subspaces of L2(0, T; L?4 (9; £9)): 


m-—1 n 


Hn ={ D xterra) (Jaxiex & (U(-,¢ 74) | exi € C, 


i=0 k=1 (12.149) 
fi € LH, (0; H)}. 
Here U(-,-) is the operator introduced in Lemma [2-101 In the sequel, we shall 
use the following norm for the linear space Hm,n, 


m-—1 n 


> X xer, em) ( “)OneR e fi 


i=0 k=1 


1 








L(0,T;L?«(0:;£9)) 
m-—1 n 


for any v - 2. x ums Jagi;ex Q (U (Efi) (E Hm,n) with api € C 
i=0 k=1 


and f; € I Q0; H). 
We have ii following result. 


Proposition 12.15. The set U Umm is dense in L2(0, T; £79(.2; £8)). 
myn=1 
Proof: We introduce the following subspace of L2(0, T; L?(£2; £9)): 


m—1l n 


finn = { D Yo xem mot Jarier ® fi 


=0 k=1 





ari € C, fi € LF, (O; H)}. 


It is clear that U Hmn is dense in L2(0, T; L?9(9; £9)). 
m,n-l 


For any m,n € N, fie LZ, (Q;H) and aj; € C (i € {0,1,--- ,m— 1}, 
k € {1,2,--- ,n]), put 


m-—1 


TL 
m a 
Um,n = ` X[t em (Jarier ® fi- 
i=0 k=1 


Clearly, Umin € Hus We claim that for any e > 0, there exist an me € N 
and a Um.n € Hm.,n such that 


aas — Um,,n L2(0,T;L?2(0;c9)) SE. (12.150) 
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Indeed, by Lemma ZIJ, for each fi, there is a 6?’ > 0 such that for all 
tetr, T- â") and s € [t,t + 07], it holds that 
|U(s, t) fi a filez (oun 
(12.151) 
< A 
V Tn max f ax;| +1 | 0<i<m-1,1<k<n} 





Now we choose an m. € N and a partition Am, of [0, T] such that Am C Am, 
and |Am.| € mino<i<m—1{67"}. Let 


meg—l n 


Ume,d = >, >x A (Jàrjex & (U (17) 3), 


j=0 k=1 


where à; = aj; and f; = f; whenever [575 tE) C E, tihi). From (I), 
we find that 


[mn = "mein | rato sonst) 








m—1 n 
=| Xiertm,)()ariee 9 fi 
i=0 k=1 
meg—l m 
= xem eme y C)àg;ex @ (U(-, t7*)ff. 
> 2. dr d i 5) L2(0,T;L?«(Q:£9)) 
meg—l m E , 
= me ,me \(-)Qz- Q (U(t DRE S «t 
p ae ame angen 8 (OC EPS — Fi) 12(0,7;L24(2;£3)) 


This proves (2150). Hence, U Hm,n is dense in L2(0, T; L?2(62; £3)). 
m,d=1 


O 
Our regularity result for solutions to (ZX) can be stated as follows. 


Theorem 12.16. Suppose that the assumptions in Theorem EZF hold and let 
(P(-), Q0, QO) be the relaxed transposition solution to the equation (ILS). 
Then, for each m,n € N, there exist two pointwise defined, bounded linear op- 
erators Qm, n and Quan both of which are from Hm» to L2(0, T; Let (£2; H)), 
such that, for any &1,€ € LZ (Q; H), ui), ua) € L31 (9; L?(0,T; H)) and 
v1(-), v2(-) € Hm,n, it holds that 














T a 
Ji (vi (s), QC (2, U2, va) (3) pods 














af (QU (& ui, v1) (s), va(s)) pods (12.152) 














= ef (Qm, nl )(s). z2(5))g + (x1(s), (Qmynv2)(s)) ,) ds, 
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where, x1(-) and za3(-) solve accordingly (IL2-39) and (L240) with t = 0. 


Proof: From the proof of the “Existence and Stability" part in Theorem 
(ZY, for each £ € N, one can find a pair of (P'(-), Q*(-)) € L£(9; D([0, T]; 
Lo(H))) x L5 (£2; L? (0, T; £2(L3; H))) so that the variational equality (IZ TUTI) 
holds. 

For any m € N, i € {0,1,---,m—1}, & € LE ,(Q;H) and v2 € L2(t”, T; 
L74(Q; C9)), letting uy = 0 and v4 = 0 in the equation ([LZ:39), and letting 
£9 = 0 and uz = 0 in the equation (240), by (C2101) with t = t^, we find 
that 


T 
E( Pra (T), £2(T)) y — Ji (F' (s)oy (s), @2(s)) yds (12.153) 


m 
i 


















































T T" wu 
= Ji (P (s) K (s)m (s), vo(s)) pods + JN (Q'(s)U (s, t^ )&x, va(s)) pods, 


m 
i 


where F* and Pf are given in (LZ). For these data £1, u1, v1, £2, u» and 
v2, from the variational equality (210M) with t = £71 ,, we obtain that 


























T 
E(Ppxi (T), xo(T)) 4 — Ji (F'(s)a (s), x2(s)) yds 






































i+1 » 
= E(P (Ea eta) salt) + JN (P'(s)K (s)my(s), vo (s) pods 
T 2 
f (Q'(s)U(s, t?" )E1, v2(5)) pods. (12.154) 


i+1 


From (IZI53) and (2-154), it follows that 


























E(P'(£^ )En rata) 4p — E Í 77 (F'(s)as (s), z2(8)) yds 


m 
i 














m 
i 


= ef a (P (s) K (s)ms (s), va (s) pods (12.155) 


dE J eri (Q*(s)U (s, t?? £x va(5)) pods, 














m 
i 


holds for any i € {0,1,---,m—1}, & € LZ „(Q H) and v9 € Let, ti; 


L?4(Q; £9)). We choose £ € LE. (2; H) with l&lgzs. (0.8) = 1 such that 


[OU t?)&| 


2p. 
LE (EP tm ,;LP*1(Q;c9)) 


[QUC £)] 


2 


N| = 


2p G 
LULZ, (3H) LEOP ta LPFI (039) 
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We then find a U2 € LU ms L?4(Q; £3)) with lvl ram em 22 (0:c9)) =1 
so that 














"qu 
Bf (Q*(s)U(s. t?*)&, va(s)) pods 


m 
i 


1 ~ 
> ~104(-)U(.. t p 2 
= zle EJU i E (2;£3)) 


Hence, 














ef = (Q(s)U(s, t?)&, v2(s)) pods 
(12.156) 
|Q4(-)U(-, t7)| 


> 


AI 


2p. . 
LULZ, (5H); LET tq Lk PFT (039) 


Also, it is easy to see that 














[PERDERE f (Peel), (9) de 


a 


(12.157) 














— d (P^(s)K (s)a (s), v2(8)) p94 


< C(IPrlzz. (ecan) + |Floxo.rsz-(acun)))- 
Combining (2153), (Z150) and (2.157), we find that 


Q*(-JU(-, t " 
OUCH )| erze (cue) rep anar co (12.158) 


&C(IPrlzs, (acu) + LFlrsco;rize(9:£(0)))- 


By (2-154) and Lemma ZTA, there exist a bounded, pointwisely defined lin- 
2p 
ear operator Qem from I (Q; H) to Lg(t, t5 ,; L+ (62; £9)), and a sub- 
sequence {f;,,}?2, of (£122, such that, for all £ € LA. (2; H), 
(w)- lim Q^«()UG. AE = Qs (JE im LET as LPH (O; £9). 
—oo 
(12.159) 


Since Qi» is pointwisely defined, for a.e. (t,w) € (t7, (714) x Q, there is a 


qe (t,w) € £(H; L$) such that, for any £ € LE „(Q H), 


(Qir £) (t,w) = gem (t, w)E(w). 


Now, for any m,n € N, let us define an operator Qm,n from Hm,n to 
L2(0, T; LPT (N; H)) as follows: 
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[Qm st) (tw) 


m-—1 n 
= x tm (t)ani(qum (t, o7) fi) ex, a.e. (t,w) € (0, T) x 2, 
i=0 k=1 
m—1 n 
where v — 5 XO xep, tm ariey Q (U(., t") fi) € Hm,n with aj; € C and 


4—0 k=1 
fie 1 (f2; H). It is easy to check that Qmnv € L2(0, T; Lei (2; H)), Qu 
is a pointwisely defined linear operator from Hm,» to L2(0, T; LPF (Q2; H)) 
and 


Qm at iE +1 (Q; ES Clio s 


For the above v, we have 


m-—1l n 

QF (s)v(s) = 5 Xp ez) ()akQ (s) (ex D (U(,17):)) 
i=0 k=1 
m—l n a 

= XP em) (Jani Q* (5) ((U CS 7") fi) ex 
4—0 k=1 
Hence, 
Q^ (v) — (Qmnv) (+) 
m-—1l n 


Xin am o ai (Q^ (5) (UC. E) i)er — (ur (tw) fedex): 


i=0 k=1 


This gives that 


(w)- lim Q^^()v() = Quav in LR(0,T; LF (Q:H) Vv € a. 
—oo 
(12.160) 
Similarly, one can find a subsequence (£2, 2, C (4,4 Z: and a point- 


wise defined linear operator Qm, n from Hm,n to L2(0,T; Leet (2; H)) such 
that 


(w)- lim Qar ()u(-)=Omnv in L2(0,T; LF (Q; H)), Vue Umm: 
—oo 
(12.161) 
For any &,é£9 € Ee (rH. ui(-), u2(-) € L2(0, T; L?*(0; H)) and v1(-), 
v2(-) € Hmn, by (IEZIGU)-(ILZ IGI), it is easy to see that 
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k—oo 


T ~ 
lim f (Q (s)ui (s), v2()) y + (Q+ (s)z1 (s), va(s)} gg ds 
0 














g —— * 
lim af ((Q'*(s)on(s),22(8)) y  (ai(s), Q^ (s)v2(s)) ds 
0 


k—oo 














p " 
= sf (Qm nvi) (5), 2208) wy + (x1(s), (Qnn.nv2)(8)) 1) ds. 


(12.162) 
On the other hand, from the proof of the “Existence and Stability” part in 
Theorem IZY, one can show that there exists a subsequence {f3,}?2, of 
(5. 4 such that 














T —— 
lim Ji ((Q%*(s)or(s),22(s)) y + (Q'»(s)2:(5), ¥2(8)) pg )ds 


k—oo 














T 7 
= J [(v1(s), QU) (£a, ua, va)(5)) ps + (Q (E1, u1, vi) (s), va(s)) po] ds. 


(12.163) 
Combining (62) and (21653), we obtain ([2152). This completes the 
proof of Theorem [LZ TH. Oo 


12.5 Pontryagin-Type Maximum Principle 


In this section, we shall present our result on Pontryagin-type maximum prin- 
ciple for Problem (OP). Let 


H(t, x, u, kı, k2) E (kı a(t, x, u) ag (Fa, b(t, £, u)) po a g(t, x, u), 


(t, z,u, ky, k2) € [O, T] x H x U x Hx £9. 


(12.164) 


We have the following result. 


Theorem 12.17. Suppose that H is a separable Hilbert space, L- (2; C) 
(1 € p< oo) is a separable Banach space, U is a separable metric space, and 
zo € L5. (2; H). Let the assumptions (S1)-(S3) hold, and let (z(-),u(-)) be 
an optimal pair of Problem (OP). Let (y(-), Y (-)) be the transposition solution 


to (CZI). Assume that (P(-),QO,Q) is the relaxed transposition solution 
to the equation (LZR) in which F(-), J(-), K(-) and Pr are given by 


| F(t) = -Hez (t, Z(t), u(t), y(t), Y(t)), J(t) = as (t, Z(t), u 
K(t) = bz (t, Z(t), u(t)), Pr = —hzs(2(T)). 


Then, 
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Re H(t, Z(t), u(t), y(t), Y (t)) — ReH(t, z(t), u, y(t), Y (£)) 


(12.166) 
Proof: We divide the proof into several steps. 


Step 1. For each € € (0,7), let E: C [0,7] be a measurable set with 
measure e. Similar to (C44), put 


u(t), t € [0,7] V Ee, 


ut(t)- NA e. (12.167) 


where u(-) is an arbitrarily given element in U[0, T]. 
We introduce some notations which will be used later. For v» = a,b, g, 


vi (t) = vs (t, Z(t), u(t)), p(t) = Welt, x(t), u(t)), 
-f Ya (t, E(t) + o(a (t) — 2(t)), v (0))do, (bas 


df) =2 ji (1— &)vss (80) + o(a (£) — a(t), u* (£))do, 


0 


and 


óv(t) = Y(t, x (t), ut) — Y(t, (t), u(t)), 
vs (t) = vs (tS E(t), u(t) — va (t, x (t), u(t), 
vai (t) = aas (t, H(t), u(t)) — Vas (t, T(t), u(t)). 


Let x*(-) be the state process of the system (Z2) corresponding to the 
control u*(-), that is, z*(-) solves 


gl 


T 


(12.169) 


gl 


dat = (Azx* 4+ a(t, x^, u*))dt + b(t, x^, u*)aW (t) in (0, T], 
( ) (12.170) 
xf (0) = zo. 
From Proposition [ZJ it follows that 
lx* \cp((0,71;28(2;H)) € C(1 + Iro|rs. (9:1): V € € (0, T). (12.171) 


Let z£(-) = z*(-) — z(-). Then, by (ILZTZIl and noting that the optimal pair 
(z(-), u(-)) solves the equation ([IZ2), we see that x$(-) satisfies the following 
stochastic evolution equation: 


dxi = (Az + a$(t)z5 + xz, (t)da(t)) dt 
+E (t)i + xz, (t)db(t))dW(t) in (0,7), (12.172) 
x; (0) =0. 
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Consider the following two stochastic evolution equations: 


dz5 = (Ax$ + as(t)z5) dt + (bi(t)v5 + xx, (t)ób(t)) aW (t) in (0,1], 
x5(0) — 0 
(12.173) 
and? 


1 
dz$ = (Aaj + ax (2 + ve, (506) + za (t) (25,25) Jat 


+(bi(t)2§ + xu, (0902 (028 + sult) (23,23) )aW(t) in (0,7), 


x3(0) = 0. 
(12.174) 
In the following Steps 2—4, we shall prove that 
laf — x5 — £3 |Cs([0,T]; L2 (9; H)) = o(t), as e 2 0. (12.175) 


Step 2. In this step, we provide some estimates on zf (i = 1,2,3). 
First of all, applying Theorem ETA to (ZIA), by the conditions (S1) and 
(S3), we find that 











sup Elzi(t)| 
te[0,T 


«es f xeadas) +8 f xe. ttti. 


By the condition in (83), it follows that 
lóa(s)|g = la(s, z(s), u(s)) — a(s, z(s), ü(s)) | y 
< Ja(s, z(s), u(s)) — a(s, 0, u(s)) |, + [a(s. 0, u(s)) — a(s, z(s), u(s))| ,, 
-Ha(s, 0, u(s)) — a(s, 0, u(s)) |, 
< d ax (s,02(s),u(s))E(s)do| + p az (s, o2(s),a(s))2(s)do| + Cr 


< C(|z(s)|n +1), a.e. s € [0, T]. 





(12.176) 


























(12.177) 
Hence, 


$ Recall that, for any Banach spaces X and Y, C?-function f() :X Y 
and zo € X, fex(%o) € L(X,X;Y). This means that, for any 71,22 € X, 
fee(to)(x1,22) € Y. Hence, by (IEZTGB), ai:(t) (75,75) (in (ILLTZ4)) stands for 
ass (t, Z(t), u(t)) (x$(£), x$(t)). One has a similar meaning for bii(t)(z$, 2$) and 
so on. 
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(fo xe.(s)|da(s)| ds)" 
Se (f. xz, G)(Iz(5)]u + 1)ds]" 
«c «(UL XE. (s)ds) ane xB. (s) (|2(s)|7 + 1) ds| ue (12.178) 


T 
«ez f Xz. (s) (E 
0 









































z(s)|§; + 1)ds 








T 
e estie exe’ jet f ss tese One® 


Here and henceforth, C(xg) is a generic constant (depending on zo, T, A and 
Cr), which may be different from line to line. As (IEZTT7), we have 


lób(s)|co < C (|z(s)|n +1), a.e. s € [0, T]. 
Hence, similar to (ZIZA), one has 


(E f. xe oit) 

Se (f Xs, (S) (Iz(s)]à + 1)as]" 

(C xe mas) Lp xz. (s) (Iz(s)]$y +1)ds| M (12.179) 
«c? f xs XE 


T 
< C (Ix Cle, to, ze co) + je f XE. (s)ds € C(zo)e*. 





























< 


e 

















z(s)|] + 1)ds 





Therefore, combining (IEZTYG), (ZIX) and (ZITA), we end up with 

a* (lest ize co: S CGo)e*. (12.180) 
From the inequality (20) and Hólder's inequality, we find that 
| zi() C ([o/T) L4 C9;H)) < C(xo)e?, 


2i Cleo z2coi € C(ro)e- 


(12.181) 


By a similar computation, for z$(-), by (IEZIT3), we have 
x5 (les zsco:my € C(vo)e", 


25 ()le.o;rizaco:i) € C(ro)e^, (12.182) 








a5) les; z2(o:) S C(xo)e- 
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Similar to ([Z:178), we have 














(f xe, Goa) nds) <Clag)e*. 


Hence, applying Theorem EIA to (ZI), it follows from ([Z182) that 











sup E|x3(t)liz 














< C{E| [ (xz. (s)|da(s)|a + [ana 5) (23 (8) 25 (8)) loe] 

















4 (f. (xx. (5)|5b1(s)x5(s)|Z0 + [brs (259). 28) 29) 4s] } 











T 4 T T 2 
«es[C f xs. (5)lõða(s)lzds) +f jea(lirds+| f bx, rdt] | 
«el*«x(|f EUM f EON 

T 


« cfe + ef XE. (5) E|0§(s)|frds) 
0 


C(zo)e*. 





























IA 


Then, by Hólder's inequality, we conclude that 
Ix$ Clos (to. Tiz2 (9:2 € C(wo)e?. (12.183) 


Step 3. We now estimate x4 2 gt — 25. Clearly, z4 solves the following 
equation: 


dz = [Ax + af(t)x§ + (af (t) — ax(0))z$ + xm, (da(t)] dt 

















+E (£)a + (OF) — b1(t)) x5] aW (t) in (0, T], 
x4(0) = 0. 
(12.184) 
Hence, applying Theorem ETA to (LIRA), by the condition (S3), we have 
sup Elax4(t)|z 
tc[0,1] 











Ie! 





E 2 
[esto ct) xs Cet] (12.188) 


«| 


+E ^ (b§(s) - TOO 




















By the condition (S3) again, we have 
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la; (s) ai(5)] eu 


=| f (G6) + ori) t9) — as a) (5) de 


"T 





= pi (as (s, 2(8) + ox$ (s), u^ (s)) — azr(s, z(s), u*(s)) 
0 (12.186) 


-as(s, (s), u*(s)) — as(s, (s), u(s)))do| 


L(H) 
= | ri (e ja dg 3s z(s) + nox}(s), u* (s))a (s)dr c XE, (s)6a1(s))do| 
«€ € (|zí(s)| y + xe-(s)), a.e. s € [0, T]. 


Hence, it follows from (2182) and (IEZTSH) that 














(f. | (af (s) — ay (s))a$ (s), ds] 














€ 2 a NS 4 1/2 
< CaO borran | (Ele(s) - e) zu,) ds 





















































(12.187) 
T dci \ 1/2 
< c(vo)e | (xe. (0 HEO) dt 
i ERUIT 2 
<C(xo)e (xe. (t) + (El2§(¢)|4,) Jat < C(zg)e?. 
0 
Similar to ([LI7S), we have 
D 2 
(f XE. (s)lóa(s)lirds) < C(zo)e?. (12.188) 
0 
As (E2188), we have 
[of (s) — bi (s)| caseo Ec dE qc + xg, (3)) a.e. s € [0, T]. 
Hence, similar to (2187), one obtains that 
T 2 
2 | | (5(s) — bx (8) e$ GS) [zs ds 
j (12.189) 














T 
: é 2 PEE: 
< CE | lbf (s) — bi (s)| zuo) [5 (8) | ds < C(zo)e?. 
Combining (Z859), (T2187), (ILZISN) and (ILLISU), we obtain that 


I4 C)lesqo.m]z2(0:2)) < C(xo)e- (12.190) 
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Step 4. We are now in a position to estimate E|z$ (t) — z$(t) — z$(t)|2; = 
w(t) — s5 (0) 


Let z£(-) = x§(-) — z$(-). It is clear that 








m 














vC) = £i (t) — 13t) — x3(t) = a^ C) — 2C) — a(t) — 23 (4). 


We claim that z£(-) solves the following equation (recall (ILZ-IGS)- (LZ. 18H) for 
the notations): 


dat = [Ang + ax(t)0§ + xn, (t)ða (taf + 5 (afa (t) — ane (62, u^) (0,24) 
gus, (ans (0 (11,21) + zan (O (ff) — 5i (5,5) at 
+ [ba (628 x (090025 + 5 (Pi (O) — baalt, 2, 9) (ota) 
&3xg, (09b (1,21) + 50 (rat) 


-5huai)]aw() in (0,7), 


xz(0) = 0. 
(12.191) 
Indeed, by (T2170), (2172), (2173) and (ZIA), it is easy to see that the 
drift term for the equation solved by x§(-) is 


Aa + a(t, a^,u^) — AT — a(t, z,u) — Avs — ai(t)x5 — Ax$ 
1 
—ai(t)z$ — xz, (t)óa(t) — gu (0) (25,25) (12.192) 


1 
= Ar; + a(t, x^,u*) — a(t, z,u*) — ax(t)(x$ + x5) — aut) (£5,125). 


For o € [0,1], write f(c) = a(t, E + ox$,u*). Then, by Taylor's formula with 
the integral type remainder, we see that 


Since f'(c) = az(t, + ox$,u*)z$ and f"(c) = az«(t, f+ ox$, u*)(z1, x), we 
obtain that 


a(t, x*,u*) — a(t, z,u*) 


E 


1 
= a4 (t, z, u*)vj +f (1—o)aze(t, + oxi, u^ )(21, £i )do (12.193) 





= as (t, T, ue ay T zi (t) (xi, i). 
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as (t, z, u^)m, — a1 (t) (23 + v5) 


= as (t, z, u^ )a — as (t, , u)g + ai(t)(v'5 — x3 — v5) 


(12.194) 
— XE, [as (t, Z, u) — Gig (E,W, tn) ut + ay (£)x$ 
= Yn, 0a; (t)r + a1(t)o$. 
Further, 
1 E E E 1 E E 
ais (0i 21) = aur (t) (25,25) 
1 e E E 1 - € E E 1 = £ E E 
= zei (21, 21) = zelt Zu (zi, a1) “Tr gsx (5 2, u )(x$, a1) 
1 = £ 1 € € 1 E E 2 
—3au(t)(zi, 1) + zan (t)(z1, 21) — zan a3, 23) (12.195) 
1 1 
= 5 (aii (t) — as (62, u*)) (a, 21) + 2x, oni (n at) 
1 E E 1 &£ € 
+5411 (t) (ri 21) - z011 (t) (13; 23). 
By (IL192)- (IZ T9H), we conclude that 
Aa* + a(t, x^,u^) — Az — a(t, 3, u) — Avs — ai(t)x5 — Ax$ 
1 
—ar(t)x3 — XB, (t)da(t) — 5a1i(t) (25,25) — xz. (t)db1 (t)z5 
1 
= Axe + ai(t)z$ + xg, (t)óai(t)o + 2l Q0) — Geli, Du) (21,21) 
1 €E € 1 E E 1 E E 
T3XE. (t)6a11(t) (3,01) + aut) (25,20) = aut) (25,295). 


Similarly, the diffusion term (for the equation solved by x§(-)) is 
1 
b(t, x^, u^) — b(t, z, u) — by (t)a5 — b3(t)x$ — ve, (t)ób(t)z5 — złu (t) (3, x5) 
1 


= bi(t)o$ + xg, (t)ôbı (t)ag + 9 ( b51(t) — bea (t, Z, u*)) (z$, a1) 


1 1 1 
T3XBE. (t)óbis (£) (x3, v1) + gut (ri, zi) = gu (t) (23, 25). 


This verifies that z£(-) satisfies the equation (IZIM). 
Applying Theorem BTA to (IIZ-TUT]), we see that 
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2 
sup E|x£(t) 
tc[0,T] les ln 


< ef 








Q 














T 
J bos. (mta oma eii) 
0 
Jta (5) — 2555.25), *(9)) (1 (8), 9) ly 


len Get), 25(8)) — an (8) (0569), 289) ts 


(12.196) 
+ / i bus. (8) (18b: (S) S) 3g + |öb11 (8) (f(s), (9) |Zo) 


0 
(6t; (5) — bze 5, (5), u°(s))) (24 (5), a 9)) [2g 
+|bra(s) (n GS), (8) — br(s) (089). 28) [23 | ds}. 


We now estimate the “drift” terms in the right hand side of (ZIG). By 
(IZ ISI), and using the condition (S3), we have the following estimate: 








2 
E | 








T 
J xe (lentia oos Gr) at) [yas 
0 




















T T 
«eg[ | vss | xe t I + i)a] 
(12.197) 

















T 
< ce [xs OEO otl 











T 
< Ce(|o S C) es co,m]z2 (0:2) + TO comes) | XE. (s)ds 
< C(zo)e?. 


By (22168) and recalling that x{(-) = x*(-) — z(-), we see that, for a.e. s € 
[0, T], 


lata (s) = ass (5, (8), u^ (5)) | cg ar) 


= efa — e)ass (s, x(s) + ea (s), uf (s))do — aza (s, (5), u= (s)) 


ME 
- [2 [a o) (ace(s.2(9)+ oot) 8) — naa 218), 016) de 
+2 [ a. es (ness) oot) (9) (12.198) 
-ass (8, (s) + 02%(s),(s)) )do 


-xn Y (aze (S, 2(5), u(s)) — aza (5. 2(8), (s)))| 


L(H,H;H) 
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< «(f laxa (s, (s) + ox$(s), u(s)) — asz(s, (s), ü(s))| pcr uade 
+X E- (3)). 


Hence, by (C2180) and noting the continuity of a44 (t, x, u) with respect to x, 
we have 














(f. |(a$4 (s) — aza(s, 2 (s), u* (s))) (xf (s), ví (s)) |, 2 











T 
" 5 B MM : 
EE [ lai; (s) — ass (s, £(s),u Greca mmli GOL dt (12.199) 














T 1/2 
3 E 4 
< Cla (lso, Tiz) f (Elai (s) — aze(s,2(8), wt (5) |ior aay) ds 


<C(ap)e? f Œf esteso ato) 

















7 i 4 1/2 
-aza (5,3 (5), (5) [eti mmda xr. (5) ds 


= o(e?°), as € > 0. 


By means of (2181), (Z852) and (IEZTJU), and noting that z4 = zf — x5, 
we obtain that 














(f |a11(s) (xf (8), z{(8)) — aji(s) (2§(s),2§(s))| ds) 














T 2 
2( i laxs Yr (8), n (9) + arr(s) (086) 5 (8) | yds) (12.200) 


(Izi CIS, cto; c2 (0:20) F x5 Oerd rra) EEO oT) 


3 


«c 
< C(xo)e A 


Next, we estimate the “diffusion” terms in the right hand side of (ZI). 
Similar to (ILI97]) and noting (2190), we obtain that 














d 2 
S f x) (lb CoD Iba 9 (19). (9) [s 
n (12.201) 


























T 
a E ni E 4 
<c 2 xz, (s) (Elzs (s) |, + Ela (s)|7,) ds € C(zo)e?. 
0 


By virtue of (C2180) again, similar to (ILZTJ9), we find that 














T 
e f le) = bor) v) CD. iG) [d 














T 1/2 
. - 4 
= Cai Olorisa | (s |t (5) bas (5, 25), u CS) [eas orco) ds 
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T 1 
«eye f Ef [bza (s. 2(5) + ox{(s), u(s)) (12.202) 





Pp" 1/2 
—bzx(s, Z(s), ü(5)) [ur gode + XE, (s)) ds 


=o"), as € — 0. 


Similar to (T2200), it holds that 














d [b1 (5) (xF (s), x{(s)) — bus (s) (x5 (s), v$ (s ) [d s < C(zo)e?. (12.203) 
From (ZIW) and (E-203), we conclude that 

lx& Cl sto myz2c0:2 = E), as t > 0. (12.204) 
This gives (Z175). 
Step 5. We now compute J (u*(-)) — A (u(-)). 


By the definition of 7(-) in (IEZ3), using Taylor's formula with the integral 
type remainder as that in (ZIJA), we obtain that 


J (u^ ()) — J (uC)) 


T 
=E [ (g(t, 2* (t), u* (0) — g(t, Z(t), u(0))) dt + Eh (a* (T)) - Eh(z(T)) 


















































T 
=ReE | (xu. (t)dglt) + (gt BOO) 2100); 
0 
+f ((1 — 0)gas (t, Z(t) + cxt (t), u(t) 24 (t), z1(0)) de) dt 
0 
*ReE(h, (z(T)), 23(T)) y 


+ReE f ((1—o)hes(#(T) ot (T))as (T), a5 (T) ydo. 























This, together with the definition of z1(-), §(-), z$(-), z$(-) and z$(-), yields 
that 


J (u^ ()) — J (aC) 


T 


eR XE. ( + (ôg (t), LI (t)) Xe. (0) + (m (0, 250) + 256) y 














(oi (0),2$()) + f ((1 — o) (den (5, x0) + 028 (0), u" (0)) 
Jaa (t, z(t), u* (t))) ai (t), xi (t)) da 


5G ORO EO) goce 0) + 5 (ma (28 (0, 28) 


mM 
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ex Gn (02500. 50) 4-250), d (12.208) 
+ReE [Kha (ET), 250) + 2§(t)) y + (he (z(T)), 2EY y 
+5 (ax (8T) 28), 250) g 5 (has (8(T)) 3(T), 04 (T) + 2§(2)) 





Similar to (IZ TUS), we find that, for a.e. t € [0, T], 


|f E- oast B0 rnt (0 50) — grs (t, 0), (0) da 


£(H) 


S c( [ | Gna (t, Z(t) + ov (t), U(t)) — gas (t, Z(t), ü(t)| do + XE, (5). 


(12.206) 


£(H) 


and 


| T (1— e) (hes (#(T) + ost (T) — hss(s(T)))de].... 
S (12.207) 


< e( [ [has G(T) + ex$(T)) — hs GT) NA ©): 


£( 


By means of (ILZZUS3), noting (2180), (ILZTS2), (25), (2190), (2.204), 
(22205) and (207), and using the continuity of both h;;(x) and grx(x) 
with respect to z, we end up with 


J (u^ ()) — J (uC)) 


z 1 
— Re J (Cat), 230) + a$(t)) y + gni (o3 (0), 5(0)) y 
0 














(12.208) 











xs, (t)89(t)) dt + ReE(hs (s(7)), 25(T) + 25(7)) y 














+5Re E( Pisce cea) AG RAC) y + o(&), ase > 0. 





We now get rid of z$(-) and z5(-) in (2208) by solutions to the equations 
(27) and (ZX). By the definition of transposition solution to the equation 
(£27), and recalling the notations in (22158), we obtain that 























T 
—E(hs (z(T))), 2§(T)) , — J (gi(t), 5 (t) pdt 
(12.209) 

















T 
-E f (Y (£), 062) zox p. (£)dt 


and 
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T 
-E(u GC) ST) -E f (oo n5) t 














T 
=E | [5 (00 21000050). 25(0)) ag + (O, (650 250)3) 
+Xx, (t) (CO óa(t)) y + (Y, b (650) 9) dt. — (12.210) 
According to (ILZ2U3)- (IIZZIU), we conclude that, when £ — 0, 
J(u’ ()) — Ful) 
T 
= GREE f^ (Can (t)ei(t).25(0))y — (WO, i30. 25(0)) 
—(Y, by (t) (x50), 8 (0)) go Jdt (12.211) 
T 
LReE xp. (£) (500) — (y(t), da(t)) y — (Y(t), 96(1)) 9) dt 
0 


+5Re E (hee (z(T))x5(T), 25(T)), + o(e). 









































By the definition of the relaxed transposition solution to the equation 
(IZ) (with F(-), J(-), K(-) and Pr given by (IEZTGX3)), we obtain that 


—E(hss (2(T))a$(T), x$(T)) y 


T 
+ Ji (Hrs. (t, E(t), (t), y(t), Y (£)) v5 (0), © (t)) yat 



































T 
=E [xe P(r (OS), (0) gdt 











qu 
+E [ xa. OPODO, bA) eg (12.212) 








T 
+E f xp. (E) (PEDE), (1) padt 





T 
y Ji (x2, (06b(£), Q (0, 0, xz. 0b) (t) podt 
0 2 




















T 
4E f (Q (0, 0, x12. 58)(t), x1, (£) 5B(t)) pod. 


By (2-182), we have 











T 
lE ^ xn, (t)(P (Obi (1)25(t), FOCE) podt 





(12.213) 











= o(e). 





T 
+E xe (D (P880), bs (t25 (6) zs dt 
0 
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By (2164) and (ILZZII)-(ILZZT3), we arrive at 
J (u^ ()) — J (aC) 


T 
=ReE | xa (D (sult) (WOA) y — (Y 0,00) gq) d 
0 














(12.214) 








T 
-ReE f (xz, (1)50(t), QO (0,0, x 0b) (£)) podt 














T 
—ReE f (Q (0, 0, xm. 85) (t), XE. (EJEDE) podt + o(€). 


Step 6. In this step, we shall get rid of the terms containing Q and Qo 
in (2274). 

In what follows, for any 7 € [0, T), we choose E; = [r,r + €] C [0, T]. 

By Proposition ZIJ, we can find a sequence {8m,,,¢, $92, such that 
Bm, t € Toa, c, (Recall (ZIA) for the definition of Hm, 7, ) and 


lim Brat, = 5b in E20 T LO L9)). 
Hence, for some positive constant C(xo) (depending on zo), 
| Bron sen |L2(0,7:L4(23£3)) € Clo) «oo, — Vn €N, (12.215) 
and there is a subsequence {np}; C {n}°2, such that 
jm IB, sen, (E) — ób(t)|ra. (2:29) —0 forae.t c [0,T]. (12.216) 
and Qu. T the corresponding pointwise defined 
to L2(0,T; L3(f2; H)), given in Theorem 


: à $ ; A A 
[LZIG. To simplify notations, we write Bk — Bmp, ln,» Qk — Qm,, Ln, and 


=~ A =~ 
Qk = Qm, fng . 
Consider the following equation: 


Denote by Qm, £ 


Ts 


linear operators from Hinn, eng 


d£ n, = (Ax n + a3 (£)25 n, )dt 
(b: (28, + Xm. (08«0)dW() im(0T, ^ (2217) 
$5 4,(0) = 0. 


Applying Theorem B14 to (IEZZT2) and by (£2215), we obtain that 














T 2 
= 2 
25 an C Mes qo Tyra Co 10) <C «(f xz, (5)| BS) [zo ds) 


«ef E 


(12.218) 














Bi s)|eods < C(zo, k)e?. 
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Here and henceforth, C (xo, k) is a generic constant (depending on zo, k, T, A 
and Cr), which may be different from line to line. For any fixed k € N, since 
Qx&y € L2(0, T; L3 (Q; H)), by (IEZZIS), we find that 














E [ xe, (0 (Quo) (0, 28 ng) gd 














€ |25 4, ie ((0,7];£4(2;H)) [a (QF) |, & count (12.219) 
C(x0,k) Ve MOP OL $ (dt = o(£), as e — 0. 
Similarly, 
T 
| J x, (t) (S n, (t), (Arbe) (t) jäl = = o(e ase—0. — (12.220) 
0 


From (IZI52) in Theorem (2-16, and noting that both Q and Qy are 
pointwise defined, we arrive at the following equality: 














T 
: (XE. (£)8(£), Q (0,0, x, 81.) (t) pot 














T 
+e f (Q (0, 0, xz, Br) (t), Xr. (0) 0k (0) co At (12.221) 


T : 
-E i: x(t) (((QiB) (0, 25, (0) s + (55,4, 0. (Oe Be) (0) dt. 
0 


Hence, 














TE t), QU (0,0, x c, 6b) ()) zs dt 








+E fe (Q (0,0, xn, 6b) (t), Xz, (€)50(t)) podt 














: d xe, (U) (D. 25 O) an + (5 ny O, (Q9) (0) 4) dt 


T 




















=E | (ve (0900), Q9 (0. xz, 30 0)) d (12.222) 
+E d (Q (0, 0, xm, ób) (t), Xp, (t)b(t)) pot 
F 








t), Q (0,0, xz, 8) (t)) pot 
T 


(Q (0,0. x, Br) (t), XE. (t)r (t)} ca t. 














El n i 


454 


It is easy to see that 














a 














(xz 
(xz, (t 
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t), Q (0, 0, xm, 5b) (t )) co dt 


t),Q (0,0, xg, &)(t) st! 
































< |E ^ t), Q (0, 0, x x, 0b) (t) » gat (12.223) 
0 
T 
= E] (xz t), QU (0,0, x, Bx) (t) F 
T 
+E f (xe t), QU (0,0, x x, B) (t)) godt 
0 





5x 


H 














q 
[ 608.0. Q9 (0.0.2, 8) at 


From (2-216) and the density of the Lebesgue points, we find that for a.e. 7 € 
[0, T), it holds that 





. . 1 
lim lim -| 
k—ooc0 € 











T 
E f (xn, (088 (6), @ (0, 0, x x 6b) (£)) padt 
0 2 








T 
E| Gas (00), GOO, 0, x2 810) el 


1p ft P 

< lim lim E| f xa CO (BDOltg) a 
L 0 2 

1 


k—o0£—20 € 
1 T 2 13 
eins dus :LU xe, (t) (Elob (Of) at 
0 ? : 


k= €30 € 
lób(r)|ra (oieo p. fT 
Lo 00 OT Mupw Te (| XE, (t) ( nj 
Ve 0 

Dr 5 3 
=C lim lim |50(7)| z4 ep f |ob(t) — Bu les, copd] 
-C Jm lób(T)|ra. (.2;£9)160(7) = 
=0. 























Fr) rator. (ae) (12.224) 














xE. (8b — Bi) |rt LaL) 














<C lim lim 
k—oo £0 








(0 - &(OI&;) a] 


Bx(T)lza. (2:29) 


Similarly, 











lim lim — 
k—oo£—0€ 





T 
SJE f Gs 0990. 9 0,0, x 4)(0) t 














T 
[| Gs 08.0 GOO, 0, xe BAO) yA 


12.5 Pontryagin- Type Maximum Principle 455 


< lim lim - -|gex 0,0 Xe B8) | z2 


k—oot& 
T 
Ul xs, (E ob 
Telra £2)) 
x "n XE, e E|ób(t) — 8k (hg) ^al i 


1 
<C lim lim z = {xml ra 0,T;L4(2;£9)) 


k—oo€ 


(0,T;L3 (Q:£9)) 


(0 - & (0&5) a] 

















<C Jum lim - 

















i 1 


- pi xx, (E (EIE — &(Ols ael 
«fs ner a} 


lób(r EX ; 
«C lim lim [—- 255 (2) T xs. (0 (Elo 


k—oo £30 
B. XE, (t e 


-C Jum lim » [lób() )ora. . (2:9) 
| prte ] 
“f |ób(t) — Bs (ls. cepat] 
=C lim ([Bb(r)|rs. (oeg lðblT) — Bi(r)lza. (2:29) 
+|50(r) — Be(r)Iz4 (oco) 
























































(EIC) - 5. coris) er] 


=0. 


From (Z223)-(ZZZ9), we find that 





; . 1 
lim lim -| 
k—ooc—0€ 











Tq 
E | (xn, (1)56(t), QU) (0,0, xe, 6b) (£)) padt 
0 2 














T 
"e I (xB. (080), O (0,0, x. 8) (£) ad 
= 0. 


By a similar argument, we obtain that 


2 
JN lób(t) - Beli, cet) 


(12.225) 


(t)— B(t) Ie) ‘af j 


i 


(12.226) 
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"m a (0) 
Jim im ZJE f^ (Q9 0.0, x89) (0. xe. (E) cat 
T 12.227 
-E f (Q9 0,0, xa. 8). xe, 5.60) di eee 
=0. 
From (ILZZIU)-(ILZ222) and (I228)- (22221), we obtain that 
T 
Ef xe. (0 (59. Q9 (0,0, x8) O) gdt 
0 2 
(12.228) 














+ f xu (QOO, 0,5) (), BC) d 
=o(e), ase 0. 

Combining (IZZO), (Z212), (Z213) and (LZ278), we end up with 
T(uF(-)) — J(u()) 


T 
z l (det) — (u(t), 5a(t)) y — (Y (€). OEY og 





=R 








[el 





- 3 (P9), b(t) og xs. (dt + ole). 


Since ü(-) is the optimal control, J (u*(-)) — J(u(-)) > 0. Thus, 














T 
Re af xe, (y(t), 6a(t)) y + (Y (t), b(t)) co 
0 (12.229) 


Gt E(P), 50(t)) pg) dt < o(c). 


as € > 0. 


Step 7. We are now ready to complete the proof, i.e., we shall deduce 
(12-166) from (Z9). This is more or less standard (e.g., [B78]). 

Since L*. (2, C) is separable, for any t € [0, T], F; is countably gener- 
ated by a sequence {M;,}?2, C Fi, that is, for any M C Fi, there exists a 
subsequence (My, 2.4 C {Mk} g such that 


Denote by [t;);24, the sequence of rational numbers in [0, T), and by 
(v, 4, a dense subset of U. For each i € N, we choose (Mij)]?2, C Ji, 
to be a sequence which generates F;,. 

Fix i,j,k € N arbitrarily. For any 7 € [t;, T) and 0 € (0, T — 7), write 
Ej = [7,7 + 0). Put 
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v*, if (t,w) € Ej x Mij, 
u(t,w), if (t,w) € (0, T] x Q)N (Ej x Mij). 
Clearly, ud € U[0, T] and 
ui (t,w) — U(t,w) = (v* — a(t, w)) xm (oxe; (t), (tw) € [oT] x 0. 


From (2229), it follows that 














647 
ReE | (H(t, 20), a(t), ¥(),¥ 0) — H(t, a(t), u; (t), y(t), Y (t) 


- 5 (P(t) (8.2), w(t) — b(t, 20), ub 0)). 
b(t, Z(t), a(t) — b(t, Z(t), uj (0)) «y )dt 


< o(e). 

(12.230) 
Divide both sides of (Z230) by r and let rT — 0*, by the property of Lebesgue 
point, we deduce that for any i,j,k € N, there exists a Lebesgue measurable 
set EX; C [t;, T) with Lebesgue measure m(E;;) — 0 such that 


ReE (H 2,20), y(t), YE) — H(t, z(t), v* (t), y(t), Y(t) 














b(t, Z(E), H(t) — b(t, Z(E), v (E) Y po Xma] $0, Vt e (ti, T) \ ER. 


Let Eg = U EE. Then its Lebesgue measure m(Eo) = 0, and for any 
i,j,k€N 
i,j,k € N and t € [t;, T) \ Eo, 


ReB| (H(t, z(t). u(t). w(t), Y ()) — B(tz(t), v* (t), y(t), Y (0) 
-3 (PU) (6(t, 2), a(t)) — b(t, 20), v^ (£))), (12.231) 
b(t, z(t), u(t)) — b(t, x(t), v*(6))) cg aas] <0. 


By the construction of {Mj;}72,, the right continuity of the filter F and the 
density of (v }?2,, we conclude from (T2231) that (L215) holds. This com- 
pletes the proof of Theorem ZTA. oO 














12.6 Sufficient Condition for Optimal Controls 


Theorem [ZTA gives a necessary condition for the optimal control. In this 
section, we shall present a sufficient optimality condition. For simplicity, we 
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assume that H is a real separable Hilbert space, the control region U is a 
convex subset of the separable Hilbert space H appeared in (84), and LE (92) 
(p 2 1) is separable. 


12.6.1 Clarke's Generalized Gradient 


In this subsection, we recall the definition and some basic properties of 
Clarke's generalized gradient. A detailed introduction to this topic can be 
found in 59]. 

Let O be a domain in H and e : O > R be a locally Lipschitz continuous 
function. For any x € O, the Clarke's generalized gradient Oy(x) of y at x is 
defined as follows: 





a(x) (€ €H | eave mm AWA yy H}. (12.232) 


z—m,zeOo t 
tlo 
We need the following lemma. 
Lemma 12.18. For the above function vy, the following assertions hold: 
1) Og(x) is a nonempty, bounded, convex subset of H. 
2) O(—~)(x) = —0v(z). 
3) 0 € Op(x) if p attains a local minimum or maximum at z. 


Proof: 1) The convexity and boundedness of Oy(x) follow immediately 
from (2.232). We only need to show the non-emptyness. 

Since o: O > R is locally Lipschitz continuous, for any z € O and a small 
ô > 0 such that Bs(x) a {ze H | |z — z| € 6} € O, there exists a constant 
Cr, > 0 so that 


le(z) — e(2)| € Crl|z — J m, V 2,2 € B(x). 
'Thus, for any fixed y € H and t » 0 is small enough, 


lp(z + ty) — v2) 
l 





<Crlyla, — Vz€ Bsja(x). 


Consequently, the following functional is well-defined: 


mu ty) — 
p(x; y) Ê lim | BENE (12.233) 
tio 


It is an easy matter to see that 
p° (x; Ay) =Av"(a;y), YyEH, A20 (12.234) 


and 
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p(z; y +z) € e" (zi) +o (m;2), Vy z € H. (12.235) 


Thus, the map y — ° (x; y) is convex. Further, the inequality (2235) implies 
that 
—-e(z;y)te(sz-y, Vy eH. (12.236) 


Next, we fix a z € H and define F : {Az | A € R} > R by 
F(Az) = Ag (z;z), VAER. 
Then for A > 0, 
F(Az) = Ag" (a; z) = p° (z; Az), 
| F(-Az) = —u (a; z) = —p° (z; Az) € e (x, Az), 


which yields 
F(Az) < P(x; àz), VAER. (12.237) 


Therefore, F is a linear functional defined on the linear space spanned by 

z, and it is dominated by the convex function y?(a;-). By the Hahn-Banach 

theorem, F can be extended to be a bounded linear functional on H. Then, 
by the classical Riesz representation theorem, there exists £ € H, such that 

l (€,Az) = F(Az) = AgP(z;z), VAER, 

(12.238) 


(Ey) < o (m;y) VyeH. 
This implies £ € Oy(a). Consequently, Oy(x) is nonempty. 
2) It follows from (12233) that 


—e(z + ty) + plz) 





(—y)°(a;y) 2 Im 





z—mrm,z€O t 
tlo 
ti t 
z— —9(z')+ (2! — ty) 
B m o» t = g” (z; =y). 
tl0 


Thus, € € 0(—y)(x) if and only if 


(-&9)u = (6 -y)u € Co (2; -y) = e" (my), Vy €H, 
which is equivalent to —£ € Oy(z). 


3) Suppose ¢ attains a local minimum at x. Then 





Of = : 
p (ay) = lm, ; 
tlo 


im Gt ty) - eo) 


t20* t 


IV 


20=(0,y)H, Vy eA, 
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which implies 0 € 0y(z). 
If p attains a local maximum at x, then the conclusion follows from the 
fact that —y attains a local minimum at zx. oO 


By fixing some arguments in a function, one may naturally define its partial 
generalized gradient. For example, if w(-,-) : H x H — R is locally Lipschitz, 
by 0,0b(a, u) (resp. O,v(x, u)), we mean the partial generalized gradient of v 
in z (resp. in u) at (z,u) € H x U. 

In the rest of this subsection, we give two technical lemmas. 


Lemma 12.19. Let w be a convex or concave function on H x H. Assume 
that (x, u) is differentiable in x and w,(x,u) is continuous in (x,u). Then 


{alâ à), r) | rea,v(2,8)) C à,,v(2,ü), v(?,à)c H xU. (12.239) 


Proof: Once (2239) is proved for convex wv; it is also true for concave 1 
by noting that —w is convex and the assertion 2) in Lemma ZIX. Hence, we 
only handle the case that 4» is convex. 

For any € € H and u € H, we choose a sequence ((5,0;)];*4 C H x Ras 
follows: 

(z;,d)€ H xU, (x; -6;6,ü + õju) € H x U, 
6; — 0*, as j > oo, and |z; — |g < 53. 
By the convexity of Y, we have 

















joo 6; 
ae a (12.240) 
Selig E a 
joo 9j 
Similarly, 
jg PUO ADU MUN a (12.241) 
joo 6; 
Also, 
lim (2, à) ET v(z;, ) > li (s (x5, à), ê — Tj)H 0 (12.242) 
j—0o Ôj joo Ôj 


It follows from (IEZZ4U)-(I-ZT2) that 


lim (xj + 0,6, à t ó;u) — v(z;, à) 





zou u),6mn- (rum. 


This, together with the definition of the generalized gradient, implies that 
(v, (£,à),r) € Oz v ($, à). H 
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12.6.2 A Sufficient Condition for Optimal Controls 


In this subsection, following B, B93] (for stochastic controls in finite dimen- 
sions), we shall derive a sufficient condition for optimal controls for Problem 
(OP), i.e., for a given admissible control u(-) € U[0, T] and the corresponding 
state z(-), we hope to find a suitable condition to guarantee (IZA) holds. For 
this purpose, for the above admissible pair (z(-), u(-)), denote by (y(-), Y (-)) 
be the corresponding transposition solution to (IZ), and by (P(-), QO, QO)) 
the corresponding relaxed transposition solution to the equation (ZX) in 
which F(-), J(-), K(-) and Pr are given by (ICZIG3)Z. Recall (216d) for the 


H(t, x, u) 2 H(t, 2, u, y(t), Y (t)) 4- 5(P(E)B(t, x,u), (ts) 


—(P(t)b(t, Z(t), (t), b(t, x, u)) zo, V (t,z,u) € (0, T] x H x U. 
We need the following intermediate result: 
Lemma 12.20. Let (S1)-(S4) hold. Then, for a.e. (t,w) € [0, T] x 2, 
O,H(t, Z(t), a(t), y(t), Y (t)) = uH (t, Z(t), u(t)). (12.243) 


Proof: Fix a t € [0, T]. Denote 


H(u) H(t, z(t), u, y(t), Y (t) 


A 


b(u)-—b(t,z(t),u), ^ w(u) 


'Then, 


) 


(P(tb(u), b(u))  — (PEBE), b(u)) jo. 


1 
2 


H(u) = Hu) + v(u). 
Note that for any r+ 0*, u,v € U, with u > u(t), 


y(u + rv) — y(u) 








1 
= =(P(t)[b(u + rv) + b(u) — 2b(u(t))], b(u + rv) — b(u)) y = o(r). 
2 Lo 
Thus, 
im H(u+rv) —H(u) "E H(u + rv) —H(u) 
u—üu(t),auceU T u— ü(t),buceU T 
ro ro 
Consequently, by (12-232), the desired result (12243) follows. Li 


Now, let us prove the following sufficient optimality condition for Problem 


(OP). 


T Clearly, the data in both (ILZ77) and (ILZN) can be well-defined for any given 
admissible pair (z(-), u(-)), not only for the optimal ones. 
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Theorem 12.21. Let (S1)-(S4) hold. Suppose that the function h(-) is con- 
vez, H(t,-,-, y(t), Y (t)) is concave for a.e. t € [0, T], a.s., and 


H(t, z(t),u(t)) = max H(t, z(t), u), a.e. (t,w) € [0, T] x 2. (12.244) 


Then (z(-),u(-)) is an optimal pair for Problem (OP). 


Proof: By the maximum condition ([L2244), Lemma and the asser- 
tion 3) in Lemma ZIA, we have 


0€09,A(t,zx(t),u(t)) = O,H(t, Z(t), u(t), y(t), Y (t)). 
Hence, by Lemma ZIY, it follows that 
(EL (t, 2(E), w(t), y(t), Y (£), 0) € 2, (t, (6), w(t), w(t), Y (0). 


This, combined with the concavity of H(t,-,-,y(t), Y (t)), yields that 


for any admissible pair (z(-),u(-)). Let £(t) 2 x(t) — z(t). Then €(t) satisfies 
the following equation: 
dé(t) = (AE(t) + as (t, x (t), u(t))&(t)  a(t))dt 
+ (ba (t, x(t), ult JEt) + B(t))dW(t) — in (0,T], (12.246) 


-~ 
Q 
— 
oh 
Se 
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— 
St 
XI 
P 
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= 
gl 
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+ 
— 
— 
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Q 
— 
St 
8 
— 
= 
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+ 
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a 
— 
St 
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— 
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By (LZZ49)-(LZ248), it follows from the definition of the transposition 
solution to (Z7) that 
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E(hs (2(T)), £(1)) y = -E(y(T), £()) y + E(y(0), €(0)) y 

T 
--E | [(ae(t, H(t), WE), EO) y + (0.0 (0) +Y, BC) 4 at 






























































T 
= J (Hz (t, Z(t), u(t), y(t), Y ()), £(0) pdt 














T 
-E f (ku). alt, x0), u(0)) — a(t, 20), (0) y 


+(Y (0), olt, w(t), u(t) — b(t, E(t), a(t))) y ) dt 





IV 











T 
of (Bis. (0. Y (0) -HE 2O, aY O))a 














T 
= Ji (uto. a(t, x (t), u(t)) — a(t, Z(t), u(t))) y 


+(Y (t), olt, w(t), u(t) — Olt, EC), (E) y ) dt 














T 
--E[ (olt, 20), ut) t. 20,80) ) dt: 
On the other hand, the convexity of h implies that 


E(ha (z(T)), £(T)),, < Eh(2(T)) — Eh(E(T)). 






































Combining the above two, we arrive at 
J (u(-)) € J (uC)). (12.247) 


Since u(-) € U[0, T] is arbitrary, ([2247) means that à(-) is an optimal control 
for Problem (OP). This completes the proof of Theorem [ZZ]. L1 


12.7 Second Order Necessary Condition for Optimal 
Controls 


In Section Z5, we have given in Theorem ZT] a Pontryagin-type maximum 
for Problem (OP), which is a first order necessary for optimal controls. Simi- 
larly to Calculus of Variations (or even the elementary Calculus), in addition 
to first-order necessary conditions, some second order necessary conditions 
are needed to distinguish optimal controls from the candidates which satisfy 
the first order necessary conditions, especially when the controls are singular, 
i.e., when these controls satisfy the first order necessary conditions trivially. 
In this section, we shall give an integral-type second order necessary condition 
for optimal controls. 
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For simplicity, as in Section [LZ.H, we assume that H is a real separable 
Hilbert space, the control region U is a convex subset of the separable Hilbert 
space H appeared in ($4), and Lf- (2) (p > 1) is separable. 

We need to introduce the following assumptionB. 


(S6) For a.e. (t,w) € (0, T) x R, the functions a(t,-,-) : Hx U > H, b(t,-,-): 
H x U > £9, and g(t,-,-) : H x U 2 R are C?. Moreover, for a.e. (t,w) € 
(0, T) x 2 and any (z,u) € Hx U, 


lazu (o, m, u) | er ñm) + brult, c, ")| cC. Bs c9) 
+|duu(t, ©, u)| egg Fe) + [buu (t, su) | egi eg) 

<C, 

lgsu (5, 4) Le cr i + Iguu (t, x, U)| pi) E Cr. 


Let (z(-),u(-)) be an optimal pair for Problem (OP). Let us introduce 
some notations. For w = a,b, g, put 
Y(t) = va (t x (t), u(t), palt) = vut, x (t), u(t), 
Vii(f) = Ves (t z(t),u(t)) ^^ Pre(t) = vuu(tz(t),u(t)), ^ (12.248) 
Vas (0) = visu (t, z(t), u(t)). 


Let (y(-), Y (-)) be the transposition solution of the equation (277). Put 





Hi (t) = Ha (t, Z(t), u(t), y(t), Y (t), 

Hə (t) = Hi, (t, z(t), u(t), y(t), Y(t)), 

H(t) = Has (t, (t), u(t), y(t), Y (t), 

H(t) = Hat, (t), u(t), y (t), Y (t), 

H2(t) = Huu (t, T(t), u(t), y(t), Y (t). 
Let (P(-),QO, QO) be the relaxed transposition solution to the equation 
(ZX) in which F(-), J(-), K(-) and Pr are given by ([2155), i.e., 


Pr = —hes(2(T)), JŒ) = a(t), 
K(t) = bi(t), F(t) = -Hi (t). 


For any admissible control u(-) € U[0, T], let z4(-) be the corresponding solu- 
tion to the following equation: 


dz, (t) = (Az(t) + ai(t)oi(£) + az (t)óu(t))at 
+(bi(t)axi(t) + b»(t)óu(t)) ÀGW(t) in (0, T], (12.249) 
x1(0) = 0, 


8 See Subsection ZILI for the notations £(H, Ñ; H), £(H, H; £3), L(A, H; H) and 
L(H, H; £3). 
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where óu(-) = u(-) — u(-). 
The desired integral-type second order necessary condition for optimal 
controls for Problem (OP) is stated as follows. 


Theorem 12.22. Let (S1)-(S6) hold, and let ü(-) € L4(0, T; H) NU[0,T] be 
an optimal control for Problem (OP). Then, for any u(-) € Lg(0,T;H)N 
U0, T] with 














E [ (Hi; (t), u(t) — a(t)) dt = 0, (12.250) 
0 


the following second order necessary condition holds: 














T 
Ji | (Hao (¢) (u(t) — u(t), u(t) — à(t))g 
+(bo(t)*P(t)b2(t) (u(t) — a(t), u(t) — a(t) | dt 














gq 
+28 f (Halt) + ale P) + bal" PO) s (0. — aD) d 


H 

















T 
i J ((Q + Q) (0, as (t) (u(t) — a(t), ba(t) (w(t) — a(t))), 


0 
ba(t) (u(t) — a(t)))) podt 
<0. 
(12.251) 
Proof: The proof will be divided into four steps. 


Step 1. In this step, we introduce some notations. 


Obviously, óu(-) = u(-) — ü(-) € LR(0, T; H). Let óz(-) = x(-) — z(-). Since 
U is convex, we see that, for any e € [0, 1], 





u*(-) = ü(-) + edu(-) = (1 — e)ü(-) + eu(-) € D$ (0,T; H) nujo, T]. 


Denote by z*(-) the corresponding solution to (Z2) with u(-) replaced by 
u* (-). Let óz*(-) = z*(-) — z(-) and for Y = a,b, g, put 


j5,() f (1 — 0)ton (t, E(t) + 662 (t), ü(t) + Oedu(t))dd, 


> 





de, (t) [ (1 — O)theu(t, E(t) + 050° (t), a(t) + Geduld, 


lib 


W5o(t) | (1 — A)duu(t, E(t) + 08x" (t), u(t) + Ocdu(t))dd. 


Also, we define 
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is. (T) 4 | "(1 — Os CT) + 0505 (T) d£. 
Obviously, óz* solves the following stochastic evolution equation: 
dóxt = | Aàa* + a4 (t)óz* + £a; (t)óu + af, (t) (x°, 8x5) 
+2ea{o(t)(dx°, du) + e?a$,(t) (du, éu)| dt 


+ [br (00x + ebo(t)du + Bi, (0) (62°, 62°) (12.252) 





+2eb§,(t) (6x*, du) + &?b5, (t) (du, 6u) | dW(t) in (0,T], 
óx*(0) = 0. 


Consider the following linearized stochastic evolution equation: 
dx» = [Azz + ay (t)z2 + a31(t) (24, 21) + 2a42(t)(x1, du) 
+a22 (t)(du, óu)] dt + [bi (t)z2 + bii(t) (21, £1) 
+2bı2(t) (21, du) + boo (t) (du, óu)] dW (t) in (0, T], 


(12.253) 


Similar to Step 2 in the proof of Theorem ZA, we can prove the following 
estimates (for some constant C, independent of &): 


92^ |cs(qo,ryz2(9:2)) S Celðul pa (or. gr); 


z1ilesqo.Tyz2(0:8)) € Clõul pa (sr. gr; F 
12.25 
X2| -12(Q:H)) € Clõul? z l ) 
2|Cr([0,T]; L2 (2;H)) > L&(0,T;H) 





bx — 21|cs([0,T]; L2(2;H)) < C|ou|7 (or. gn 


Step 2. We claim that there exists a subsequence {£n}; C (0,1] such 
that limno En = 0 and 


2 


ór^" — £421 — — 79 


i —o(c2), asn—oo. (12.255) 


Cr ([0,7]; L2(Q;H)) 





2 
To show this, we write r$(-) = e7? (62°(-) — €44(-) — gn). Then, r$(-) 
fulfills 
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arg = { Arg + ar + [otio (“= 99) — Sai.) 
Óóx* 


+ [zaia (Z, ou) = ara(t) (#1, 6u)| 





t (z(t) = gen(t)) (du, õu) bat 
Hbri [OZ 9) Tere] — 02999 


«io nata] 





(8546 = Statt) (5u, õu) baw (1) in (0, T], 








r$(0) = 0. 
B Hott) = [at 0 (20, 9909) — $i (0, 0)] 
i L € ' € 2 , 
J [2a5;(t) es óu(t)) — ayx(£)(z(£), 6u(t)) 
(a5) — 52:0) Gut), dult) 
and 





[: óx*(t) óx*(t) 
€ , 


7,.) = [Bi c( A) - abu) (5.280) 


[itat (ZE, out) — be), da) 








+ (big (t) — 5220) (Gult), du(t)) 
We have that 




















J E dig. n S(t — s)bi(s)r$(s)dW (s) 
0 0 





E|r3(t)|;, =E 











+f St — s)tre(s)as+ | S(t — s)U» «(s)dW(s) - 






































t t t 
<C(E | irse e f peld +E f Was (gas). 

0 0 0 

(12.257) 

By (12.254), there exists a subsequence {en}; C (0, T] such that €en — 0 
and x*^(-) + z(-) (in H) ae. in [0, T] x 2, as n — oo. Then, by (2254), the 
condition ($4) and Lebesgue’s dominated convergence theorem, we deduce 
that 
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t 
lim af |W e, (£)| Z5 dt 
0 

















< jim E f. [[iteo (120,970) - Lotto 0) 
ôx” (t) 





4 [ats (e ,du(t)) — ajx (t) (ai (t), óu(t))| 


TL 





ES (a3 (t) — Saxx(t)) (0u(t), su(t)| at 















































T 
ET ÔE (t) da (t) T 2 
«C lim Ef. [ano (S, 9299) aoe 42258) 
" 1 2 
+A) — 5e]... e OT 
be buen (t nie 2 
fago (17 0. sut) — aso Gs (0). duce] 
EN 2 
+2883 0) — aix [zug gal COT nOD 
"T 1 2 
«Jazz (t) — gent. PALLZOM dt 
= 0. 
Similarly, : 
lim E n (Fo e, (£) sat = 0. (12.259) 
n— 0o 0 2 


Combining (12257), (Z259) with (ILZ25J) and using Gronwall’s inequality, 
we obtain (T2255). 


Step 3. By Taylor's formula, we see that 
g(t, x^ (t), u° (t)) — g(t, x (t), u(t)) 
= (gi(t), óx* (£)) y + &(ga(t),0u(t)) g + (Ji (t) (t), da°(t)),, — (12.260) 
2e (gis (t)óx* (t), óu(t)) = + €7(G59(t)du(t), du(t)) g 
and 
h(a* (1)) — h(z(T)) 
= (haz (T)), 62° (T) y (AE, 7)52* (T), 62° (D) y 


Using a similar argument as the proof of (2255), we can show that, for 
the subsequence (2,122. such that x*^(-) > z(-) (in H) a.e. in [0, T] x Q (as 
n — oo), the following equalities hold: 


(12.261) 





2 
n 


1 = AE. E E 
lim — Ji (Cats (002 " (t), dx" (£)) y — (gui (t) (0,21 (0) )at — 0, 


n—oo E2 
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1 E m e 2 
lim —E i: (2(952 (0)02*7 (€), endu(t)) g — £2 (g12(t)z1 (t), du(t)) gat = 0, 


n—oo E2 


T 1 
lim Ji ( (a3 (t)du(t), óu(t)) = — 5 (g22(t)du(t), du(t)) z) dt =0 






































and 

: LN Ten (= En En e2 = 

lim s E (Ges otro (T), 62°" (T)) , — 2 Quas (8D) D), 21(T)) 1) 
= 0. 


These, together with (2255), imply that 
J (ue) — J (u) 
T 2 
= Ji ETOLA + =” (g(t), @2(t)) a ae En(g2(t), bu(t)) g 


2 


+2 (0i (9. zi(t) HF 2(gia(t)ai (t), óu(t)) g 





























Step 4. By the definition of transposition solution to (ILA), we have that 
T 

m Ji ((y(t), aa (£)5u(£)) y + (Y(t), bolt) öU) oo (12.263) 
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--E (CO a11(£) (21 (£), a3 (£))) y + 2(y (t); ax2 (0) (1 (t), 0u(t))) y 
+(y(t), a22 (t) (du(t), óu(t))) y F (Y(t), bıı (t) (xı (t), z1 (t))) ee 
+2(Y (t), bis (t) (x1 (t), óu(t))) ro + (Y (t), bo (t) (óu(t), du(t))) po 


+(gu(t),2(t)) y) at. 





(12.264) 
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On the other hand, by the definition of relaxed transposition solution to (23), 
we obtain that 


E(hae(&(T))x1(T),21(T)) y 

——E L ((PWar(0), ag(t)du(t)) y + (w(t), P(t)as(t)óu(t)) y 

+(P(t)bi(t)a1(t), ba(t)du(t)) po + (bi (t)a1(t), P(t)be (t)du(t)) po 

+(P(t)bo{t)du(t), bo(t)du(t)) po + (QU (0, a(t)óu, ba(t)6u)(t), bo(t)du(t)) po 

+(Q (0, a2(t)ðu, ba (t)du)(t), ba(t)du(t)) po — (Hai (t)z (t), 03 (0)) yy ) dt- 
(12.265) 


Combining (ILZ2G2)-(IL2-2ü53) with (Z250), we obtain that, for sufficiently 
large n, 









































( (P(t)bo(t)du u(t), be(t)du(t)) po 
bees is dul))y + ales 
(Y(t), bia (£)(21,0u)) po + (a2(t)* P(t)mi (£),9u(0)) z 
"P(t)by (t)z pur 
-z (Q (0, as (t)6u, b2(t)ðu) (t) + Q (0, az (t)óu, ba (£)5u) (t), 
by(t)óu(t)) Jerem 
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+5 OO POU), 5u(t))g| dt 
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T 
|j ([Hiz (t) + az (£)* P(t) + bo(t)*P(t)bi (t)] ai (£), 0u(1)) pdt 











- E ni i (Q (0, az(t)õu, bo(t)du)(t) + QO (0, az(t)ðu, ba (t)óu)(t), 
0 
by (t)óu(t)) podt + o(1) 


ge 
E : (5 o20u(0), du(t)) g ^5 (02 (0* POU), u(t) a) dt 
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-E [ (1:0) eni POH POP) ns (0, Bult) at 














== ri (QQ, a2 (t)óu, bg (t)à u) (t) + ( )(0) (0, a (t) j ; l (t) \(t), 
0 2 U, 02 óu 


Finally, letting n — oo in the above inequality, we then obtain the desired 
second order necessary condition ([LZZAT). This completes the proof of Theo- 
rem ZZ. r1 


Remark 12.28. It is easy to see that, the correction part (QO,QO) of the 
relaxed transposition solution (P(-), (QU, QC) to the equation (LZA) appears 
explicitly in the second order necessary condition ([[LZ.25T) in Theorem ZZA. 


12.8 Notes and Comments 


The main body of this chapter is an improved version of the results in [242, 
244], except that Sections and IZZ are based respectively on [24T] and 
[240], while the sufficient optimality condition in Section [ZG can be regarded 
as an infinite version of the similar result (for stochastic controls in finite 
dimensions) in B, B93]. 

Pontryagin's maximum principle for deterministic optimal control prob- 
lems in finite dimensions is one of the three milestones of modern optimal con- 
trol theory. Since the classical works in [B4], the theory of maximum principle 
for controlled ordinary differential equations has been studied extensively and 
many different versions of maximum principle were established for more com- 
plex systems in various aspects, such as control systems governed by ordinary 
differential equations on manifolds, partial differential equations, stochastic 
differential equations in particular. We refer the readers to |D, 202, 871] for 
Pontryagin-type maximum principle for these three kinds of control systems, 
respectively. 

Soon after the work [34], the maximum principle has been extended to the 
controlled stochastic differential equations. To our best knowledge, the first 
paper concerning the stochastic maximum principle is [ISU]. At that early 
time, people usually assumed that the diffusion term is nondegenerate, and 
hence one can apply the Girsanov transformation to obtain the desired nec- 
essary conditions for stochastic optimal controls (e.g., [L39]). A breakthrough 
was made in [31], in which the backward stochastic differential equation was 
introduced to study the maximum principle for stochastic control systems, and 
via the nondegenerate condition on the diffusion terms was dropped. Further 
development in this respect can be found in [25, B3], etc. 

Until 1988, all the works on maximum principle for controlled stochastic 
differential equations were obtained under one of the following assumptions: 
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e The diffusion term is independent of the controls (e.g., [25 BI); 
e The coefficients of the diffusion term is nondegenerate (e.g., [L39]); 
e The control region is convex (e.g., [25]). 


In [273], a new maximum principle was obtained for general controlled stochas- 
tic differential equations without the above mentioned assumptions, and it was 
found that the corresponding result in the general case differs essentially from 
its deterministic counterpart. 

Naturally, one expects to establish the Pontryagin-type maximum for con- 
trol systems governed by stochastic evolution equations. A pioneer work 
along this line is [26]. Further progresses are available in the literature 
(148, BA, 824), H92] and so on. Similar to the study of controlled stochas- 
tic differential equations, all of the existing published works before 2012 on 
the necessary conditions for optimal controls of infinite dimensional stochastic 
evolution equations addressed only the case that one of the following condi- 
tions holds: 


e The diffusion term does NOT depend on the control variable, or the control 
region is convex; 

e Fora. (t,w) € (0, T) x 2 and any (x,u, ki, k2) € H xUx Hx £2, the data 
( ki, Gina (5,0 by (k2, Dee ie, u) Ieo Gea (t, £, u) and hz, (x) are Hilbert- 
Schmidt valued operators. 


The main difficulty in the infinite dimensional setting is how to handle the 
well-posedness of (IZ). There were several works ([79, LA, 242], of which 
the arXiv versions were all posted in 2012) addressed to overcome the above 
difficulty. The main idea is to solve the equation ([LZ.) in a weak sense. In 
(79, IIT2], a partial well-posedness result for (LZA) was established, that is, only 
P was obtained by Riesz Representation Theorem (See [[LT3, [ITA] for further 
related works). In [242], a complete well-posedness result for (IZ) was derived 
by means of the stochastic transposition method. Results in [242] have been 
further improved in [244 245]. Although the correction part Q (in the equation 
(IZX)) is not need in establishing the Pontryagin-type maximum principle for 
controlled stochastic evolution equations, as mentioned in Remark (for 
a weak version of Q), it plays an important role in the study of the second 
order necessary conditions for optimal controls (See [IU3, t04, 240] for more 
details). 

As far as we know, the sufficiency of the Pontryagin-type maximum prin- 
ciple was first studied in [B3] for controlled stochastic differential equations. 
In [893], it was proved that the maximum condition in [Z73| is also sufficient, 
provided that some convexity conditions on the control regions and the cost 
functionals are imposed. Some further development in this respect can be 
found in [269] and the references cited therein. To our best knowledge, there 
exist only very few published works on the sufficiency of the Pontryagin-type 
maximum principle for controlled stochastic evolution equations in infinite 


dimensions (e.g., [194], 268]). 
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There are many open problems related to the topic of this chapter. We 
shall list below some of them which, in our opinion, are particularly interesting 
and/or important: 


1) Well-posedness of (28) in the sense of transposition solution 


In Theorem ZY, we established the well-posedness of the equation (IZA) 
in the sense of relaxed transposition solution. It would be quite interesting 
(and also very important for some problems) to prove that this equation is 
also well-posed in the sense of transposition solution (See Definition ZB). 
Nevertheless, so far the well-posedness of (I[LZ.N) in the sense of transposition 
solution is know only for some very special case (Se Theorem ZIA). As far 
as we know, it is a challenging (unsolved) problem to prove the existence of 
transposition solution to (IZA) (See Theorem [Z7 for the uniqueness result), 
even for the following special case: 





dP = — A* Pdt — PAdt + Fdt + QdW(t) in (0, T), 
(12.266) 


P(T) = Pr, 


where F € Lg(0, T; L?(2; £(H))), Pr € L}, (2; £(H)). The same can be said 
for (12266) even for concrete problems, say when A = —A, the Laplacian 
with the usual homogenous Dirichlet boundary condition (even for the case 
of one space dimension!). 


2) Optimal control problems with endpoint/state constraints 


In this chapter, we have not considered the endpoint /state constraints to 
the control systems since this topic is quite difficult even for the case H — IR". 
For some special constraints, such as Ex(T’) > 0, one can use the Ekeland prin- 
ciple to establish a similar Pontryagin type maximum principle with nontrivial 
Lagrange multipliers. However, for the general case, one does need some fur- 
ther condition to obtain nontrivial results in this repect, as shown in [202] 
(even for the deterministic optimal control problems in infinite dimensions). 
In the study of the aforementioned deterministic optimal control problems, 
people introduce the so-called finite codimension condition to guarantee the 
nontriviality of the Lagrange multiplier (e.g., [202, 220]). There is some at- 
tempt to generalize this condition to the stochastic framework (e.g., [221]) 
but so far the results are still not so satisfactory. Another way is to use some 
tools from the set-valued analysis, as developed in the recent paper [IU]. 














3) Higher order necessary conditions for optimal controls 


As mentioned at the very beginning of Section IZM, similarly to Calculus 
of Variations or even the elementary Calculus, in addition to the first-order 
necessary conditions, sometimes higher order necessary conditions should be 
established to distinguish optimal controls from the candidates which satisfy 
the first order necessary conditions trivially. In this chapter, we only gave one 
result of integral-type second order necessary condition for optimal controls of 
Problem (OP). Some further results in this direction can be found in (103), [TUA 
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240]. However, the theory on higher order necessary conditions for stochastic 
optimal control problems is far from satisfactory. Indeed, as far as we know, 
so far only second order necessary conditions for stochastic optimal controls 
were under consideration, and pointwise second order necessary conditions 
(which are more useful in applications than the integral ones) were obtained 
only under very strong assumptions, even for the stochastic control problems 
in finite dimensions. 


4) Necessary conditions for optimal controls of partially observed 
control systems 


In this chapter, we actually assumed that the system state is completely 
observed. For many practical problems, it often happens that only a part of 
the state can be observed, and also there might exist noises in the observation. 
A typical example is as follows: 

Let Wı and Wa be two independent cylindrical Brownian motions on the 
filtered probability space (2, F, IF, P), with values in two Hilbert spaces V; and 
V2, respectively. For a given control u(-) € U[0, T] (See (£Z) for the definition 
of U[0, T]), let us consider the following stochastic evolution equation: 


dx(t) = (Az(t) + a(t, x(t), u(t))) dt 
+) > d;(t,2(t),u(t))dW;(t) in (0,T], (12.267) 


j=l 
x(0) = Xo, 


and the following (partial) observation equation: 


dy(t) = c(t, x(t), y(t), u(t) )dt + f(t, x(t), y(t), u(t))dWa(t) in [0, T], 


y(0) = yo, 
(12.268) 
with suitably given initial values £o and yo, and functions a, b1, b2, c and f. 
For any t € [0, T], write 


Xi S e(y(s) | s € (0, ¢}}. 


We call the above control u(-) an admissible control for the above partially 
observed system if it happens to be (Y; }+e[0,rj-adapted. Denote by V[0, T] the 
class of all admissible controls for the above partially observed system. 

People then hope to find a control u(-) € V[0, T], which minimizes the 
following cost functional: 














T 
IUD e E[ f. atat ott dE], u) € vio, 


in which the functions g and h are suitably given. 
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Motivated by the works for the same problems but in finite dimensions 
(e.g., Z7), one may follow the following two main steps to study the above 
optimal control problems of partially observable systems governed by stochas- 
tic evolution equations: 


e Step 1. Computing the filtering of the state; 
e Step 2. Solving a complete information optimal control problem driven by 
the filtering and obtaining the optimal control. 


Nevertheless, compared with the partially observed systems in finite dimen- 
sions (e.g., [27, B39, BG3]), there exist some essential difficulties to achieve the 
above two steps. For example, in Step 1, one has to solve a stochastic partial 
differential equation with infinitely many variables to compute the filtering 
of the state. Unfortunately, at this moment the well-posedness of such an 
equation is far from well-understood. 


®) | 
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Linear Quadratic Optimal Control Problems 


In this chapter, we are concerned with linear quadratic optimal control prob- 
lems (LQ problems for short) for stochastic evolution equations, in which 
the diffusion terms depend on the control variables and the coefficients are 
stochastic. In such a general setting, one has to introduce suitable operator- 
valued backward stochastic evolution equations (to characterize the optimal 
controls in the form of Pontryagin-type maximum principle or in the feedback 
forms), served as the second order adjoint equations or the Riccati type equa- 
tions. As in the previous chapter, it is very difficult to show the existence of 
solutions to these equations. We shall use the stochastic transposition method 
to overcome this difficulty. 

Compared with the general optimal control problems, the main novelty of 
LQ problems is that the optimal controls can be represented in the feedback 
forms, which keep the corresponding control strategies robust w.r.t. (small) 
perturbation/disturbance. This is particularly important in many practical 
applications for which perturbation/disturbance are usually unavoidable. N- 
evertheless, it is actually very difficult to find feedback controls for general 
control problems. So far, the most successful attempt in this respect is that 
for various LQ problems in the deterministic setting. 


13.1 Formulation of the Problem 


Throughout this chapter, T > 0, (Q, F, E, P) (with F 2 C eto) is a fixed 
filtered probability space satisfying the usual condition, and we denote by 
F the progressive c-field w.r.t. F; H, V and U are three separable Hilbert 
spaces. We denote by I the identity operator on H and by In the identity 
matrix on R” (n € R), and £$ 4 L2(V; H). Unless otherwise specified, W (-) is 
a V-valued, Q-Brownian motion or cylindrical Brownian motion but we only 
consider the case of cylindrical Brownian motion. Let A be an unbounded 
linear operator (with domain D(A) on H), which generates a Co-semigroup 
(5(t))so. Denote by A* the dual operator of A. 
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Denote by S(H) the Banach space of all self-adjoint (linear bounded) 
operators on H. For M,N € S(H), we use the notation M > N (resp. M > 
N) to indicate that M — N is positive semi-definite (resp. positive definite). 
For any S(H)-valued stochastic process F on [0, T], we write F > 0 (resp. 
F 0, F > 0) if F(t,w) > 0 (resp. F(t,w) > 0, F(t,w) > ôI for some ô > 0) 
for a.e. (t,w) € [0, T] x 2. One can define F « 0 and so on in a similar way. 

For any given 7 € H, we consider a control system governed by the fol- 
lowing linear stochastic evolution equation: 


de(t) = (Ax(t) + B(t)u(t)) dt 
+(C(t)a(t) + D(t)u(t))dW (t) in (0,7), (13.1) 

«(0) =n, 
where B(-) € Lg(0,T; £(U; H), CC) € Lg(0,T; £(H;£9)) and D(-) € 
Ls? (0, T; £(U; £3)). In (ŒD), u(-)(€ L2(0, T; U)) is the control variable, z(-) is 
the state variable. In view of Theorem ETA, for any u € L2(0, T; U), the system 
(EZI) admits a unique (mild) solution z(-) = x(-;7,u) € Ce([0, T]; L?(2; H)) 
such that 

Ix C)lesto;rz202:2) € C (Ila + Iu(-)1z2t,r;.v))- (13.2) 


Associated with the system (ILLI), we consider the following quadratic 
cost functional 














1 T 
Fenn) = FELS (Ms), (0) + RO uc) d 


(13.3) 
+(Ge(T),2(T)) x}, 


where M(-) € Lg (0, T; S(H)), RC) € LẸ (0, T; S(U)) and G € LE (2;S(H)). 
In what follows, to simplify the notations, the time variable £ will be sup- 
pressed in B(-), C(-), D(-), M(-) and R(-), and therefore we shall simply 
write them as B, C, D, M and R, respectively (if there is no confusion). 


Remark 13.1. In this chapter, we assume that B € LẸ (0,T;£(U; H)) and 
D € Lg? (0, T; £(U; C9)). Thus, our results can only be applied to controlled 
stochastic partial differential equations with internal controls. To study sys- 
tems with boundary/pointwise controls, one needs to introduce some further 
assumptions, such as the semigroup {S(t) }:ejo,r] has some smoothing effect. 
Under these conditions, many results of this chapter can be generalized to 
systems with unbounded control operators. More details will be discussed in 


Section [LL TU. 


The main concern of this chapter is to study the following stochastic linear 
quadratic optimal control problem: 


Problem (SLQ). For each 7 € H, find a ü(-) € L2(0, T; U) such that 
Jy u()) = inf — J(mu()) (13.4) 


u(-) € L2(0,T;U) 
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Remark 13.2. Unlike Chapter IA, we denote by J(n;u) rather than J(u) for 
the cost functional. The reason is that we want to emphasize the relation- 
ship among the initial data, the optimal controls and the optimal feedback 
operators. 


Let us begin with the following notions. 


Definition 13.3. 1) Problem (SLQ) is called a standard LQ problem if 
M()20, R»0, GSO; 


2) Problem (SLQ) is said to be finite at n € H if the right hand side of 
(3.2) is finite; 

3) Problem (SLQ) is said to be (uniquely) solvable at n € H if there exists a 
(unique) control u(-) € L2(0, T5 U) satisfying (CZA). In this case, ū(-) is called 
an (the) optimal control, the corresponding z(-) and (x(-),u(-)) are called an 
(the) optimal state and an (the) optimal pair, respectively; 

4) Problem (SLQ) is said to be finite (resp. (uniquely) solvable) if for any 
n € H, it is finite (resp. (uniquely) solvable) at n. 


Let us briefly review the deterministic LQ problems in finite dimensions 
(See (93, B70] for more materials). 
For any m, n € N and 7 € R”, we consider the following control system: 
a(t) = A(t)x(t) + B(t)u(t) in [0, T], 
(13.5) 
| «(0) =n, 


where A(-) € L?*(0, T; R^*^), B(-) € L®(0,T;R”*™) and the control u(-) € 
L?(0, T; R”). The cost functional is 


T 
J(mu()) = 5 pi ((M El), x(t))no + (R(t)u(t), u(t))em) dt 


+(Gz(T),2(T))r ]. 


with M(-) € L®(0,T;S(R”)), R() € L®(0,T;S(R™)) and G € S(R?). 
Similarly to Problem (SLQ), we consider the following (deterministic) linear 
quadratic optimal control problem: 


Problem (DLQ). For each 7 € R”, find a control u(-) € L?(0, T; IR"), such 
that 
J(mu()) = J (m u(-)). 

A special case of the above problem has already been introduced in Section 
[L3. Similarly to that for Problem (SLQ), one can define the so-called standard 
Problem (DLQ), and the finiteness and (unique) solvability of Problem (DLQ) 
(and hence we omit the details). 

The following result (e.g., [B70, p. 227]) shows that R > 0 is a necessary 
condition for Problem (DLQ) to be finite. 


inf 
u(-) € L2(0,T;Rv) 
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Proposition 13.4. If Problem (DLQ) is finite, then R > 0. 


Remark 13.5. Surprisingly, it was found in [55] that in the stochastic setting 
R > 0 is NOT a necessary condition anymore for Problem (SLQ) to be finite 
even for the case of finite dimensions (See also Example L310). 


The following example shows that Problem (DLQ) may not be finite (need- 
less to say solvable) even if R >> 0 (but Q and G are indefinite). 


Example 13.6. For m — n — 1, let us consider the control system 
d. 
aT u in [0, T], 
dt (13.7) 


z(0)—mcR, 


with the cost functional 
1p o" 2 2 
3:0) = 5[ f, «ta - Tay]. (13.8) 
Let A € R and take u) (t) = A for t € [0, T]. Then 
iL 1 2 
J(muxC)) = JAT - SOT ]) — —oo as À > oo. 


Thus, the corresponding LQ problem is not finite. 


Because of Example [EEG, in order that Problem (DLQ) is solvable, one 
needs more assumptions besides R > 0. For any u(-) € L?(0, T; R™®), define 
two operators L : L?(0, T; IR") — L?(0, T; R”) and Lr : L?(0,T;R™) > R” 
as follows: 

(Lu(-))(t) = x(t;0,u(-)),  Lru = x(150,u(-)), 
where z(:;0, u(-)) solves the equation (LZA) with 7 = 0. Further, define 
N=L*ML+L7,GL7 +R. 


The following result (e.g., B70, p. 229]) characterizes the unique solvability of 
Problem (DLQ) under suitable assumptions: 


Theorem 13.7. Suppose that N > 0 and R(-) >> 0. Then, Problem (DLQ) is 
uniquely solvable if and only if the following coupled forward-backward system 


) = A(Dz(t) - B(t)R (tB (tyt), X t € (0, TI, 
) = -A(t)' g(t) + MM), t € [0,7], (13.9) 
(02-7, |y(T)--Gsz(T) 


&I 


(t 


| 
= 
= 


XI 


,gC)). In this case, 





admits a unique solution (z(-) 
alt) = R HHB! (Og), | te([0,T], (13.10) 


is the optimal control. 
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One task of this chapter is to establish a characterization on the unique 
solvability of Problem (SLQ) similarly to that in Theorem LZA for Problem 
(DLQ). This will be done in Corollary (in Section L35). 

Note that the optimal control given by (IL IU) is not in a feedback form. In 
Control Theory, another fundamental issue is to find feedback controls, which 
are particularly important in practical applications. Indeed, the main advan- 
tage of feedback controls is that they keep the corresponding control strategy 
robust w.r.t. small perturbation/disturbance, which are usually unavoidable 
in realistic background. 

In order to find a feedback form of ü(-), formally, we assume that, for some 
R”"*"-valued function P(-) (to be determined later), 


g(t) = —P(t)z(t), t € [0, T]. (13.11) 
Combining this with (EZ TU), we obtain an optimal feedback control as follows: 
a(t) = —R"B'P(t)z(t),  te[0T] (13.12) 


In order to find the above P(-), proceeding as that in |37U, pp. 230-231], 
differentiating (EX) w.r.t. t, using (IEZJ) and (3-72), we obtain that 


A(t)" PZ + Mz = a = -23 — P(A(t)z + Bu) 
dP _ : -ipT px 
--u E-P(A(Qs- BR" B" P3), 


which yields 
dP T SIT = 
0- (5 + PA(t) + At) P — PBR“B P+M)z. 


Thus, if we choose P(-) to solve the following Riccati equation (associated with 
Problem (DLQ)): 


E. + PA(t) + At)! P- PBR! B'P-- M —0 in [0, T], 
dt (13.13) 
P(T) 2d, 


then ([LLIT) and (ILZT2) hold. Clearly, (IELT3) is a matrix-valued nonlinear 
ordinary differential equation. 

The following result (e.g., [37U, p. 234]) shows the equivalence between the 
unique solvability of Problem (DLQ) and the global solvability of the equation 
(LIJ) under suitable assumptions: 


Theorem 13.8. Suppose that R >> 0. Then, for any n € R”, Problem (DLQ) 
is uniquely solvable if and only if the Riccati equation (TZIA) admits a global 
solution P(-) € C((0,T];S(R”)). In this case, the optimal feedback control is 
given by (IELT2), and 


J (9) = L(P(0)n nee. (13.14) 


inf 
u(-) € L2(0,T;R") 2 
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It is easy to show that any standard LQ problem (even in the stochastic 
setting) is uniquely solvable. Hence, thanks to Theorem IZA, one can find 
a unique optimal feedback control for any standard Problem (DLQ). Nev- 
ertheless, things are completely different in the stochastic situation. Indeed, 
as shown in B30, Example 6.2] (See also Example in Section EZA), 
a standard Problem (SLQ) (even in finite dimensions, i.e., both H and U 
are Euclidean spaces) does NOT need to have feedback controls. This is a 
significant difference between stochastic LQ problems and their deterministic 
counterparts. Indeed, Theorem means that, under the assumption R > 0, 
one can always find the desired feedback control through the corresponding 
Riccati equation whenever Problem (DLQ) is uniquely solvable. 

Because of the difference mentioned above, in the present stochastic setting 
it is quite natural to ask such a question: Is it possible to study directly the 
existence of optimal feedback controls (rather than the solvability) for Problem 
(SLQ)? Clearly, from the viewpoint of applications, it is more desirable to 
study the existence of feedback controls for Problem (SLQ) than its solvability. 

Another task of this chapter is to give an affirmative answer to the above 
question under sharp assumptions on the coefficients appearing in (IET) and 
(I3). For this purpose, let us introduce below more notions. 


Definition 13.9. Any O(-) € Y2(H;U) is called an admissible feedback oper- 
ator for Problem (SLQ). 


Remark 13.10. In order to keep the feedback controls to be robust w.r.t. s- 
mall perturbations, we should choose the feedback operators so that they are 
bounded linear operators from L2(0; C((0, T]; H)) to L2(0, T; H). This is the 
reason to introduce T3(H;U). 


Now, motivated by [Z38, BUJ, BUX], we introduced the following notion of 
optimal feedback operator for Problem (SLQ): 


Definition 13.11. An admissible feedback operator O(-) € YT2(H;U) is called 
an optimal feedback operator for Problem (SLQ) if 


IM OOE) € Z(mu()),  V(mu())e H x D(0,T;U), — (13.15) 
where z(-) = (59g, O(-)z(-)) solves 
l " (Az + BOz)dt + (Cz + DOz)aW(t) in (0,T], T 
z(0) — m. 


Clearly, for a fixed 7 € H, the inequality (L318) implies that the control 
ul) = O(-)z(-) € L2(0, T; U) is optimal for Problem (SLQ). Therefore, for 
Problem (SLQ), the existence of an optimal feedback operator implies the 
existence of an optimal control for any initial state 7 € H, but not vice versa. 


! Recall (B50) for the definition of %(H;U). 
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In the study of Problem (DLQ), people introduced the Riccati equation 
(X13) to construct the desired feedback controls. Stimulated by this and es- 
pecially by the pioneer work [B2] (for stochastic LQ problems in finite dimen- 
sions), in order to study the optimal feedback operator for Problem (SLQ), we 
introduce the following operator-valued backward stochastic Riccati equation: 





dP =—(PA+ A*P+ AC+C*A+C*PC+M 
—L*k~'L)dt + AdW (t) in [0, T), (13.17) 
P(T) =G, 


where 
K = R+ D*PD, L = B*P + D* (PC + 4). (13.18) 


Note that, the presence of the control variable in the diffusion term of 
(IT) and the infinite dimensional setting make Problem (SLQ) (and in par- 
ticular the study of (IELT7)) significantly different from LQ problems for or- 
dinary differential equations or stochastic differential equations. To illustrate 
this, we present in the next two sections some basic results for LQ problems 
for the latter two cases, respectively. Then, we go back to the study of Problem 
(SLQ). One can see the difference caused by the infinite dimensional setting. 

The rest of this chapter is organized as follows. In Sections and EZI, 
we revisit some important aspects in the LQ problems for ordinary differential 
equations and stochastic differential equations, respectively. In Section E34, 
we give the finiteness and solvability of LQ problems for stochastic evolution e- 
quations. In Section [LB we establish Pontryagin-type maximum principle for 
optimal controls. In Section [30 optimal feedback operator and the stochastic 
Riccati equation are introduced. In Section LZM, the optimal feedback oper- 
ator is represented through the solution to the stochastic Riccati equation. 
Section is devoted to the solvability of the stochastic Riccati equation. In 
Section L29, we present some examples for LQ problems of stochastic partial 
differential equations which satisfies the assumptions in this chapter. Finally, 
some remarks and open problems are given in Section L210. 


13.2 Optimal Feedback for Deterministic LQ Problem in 
Finite Dimensions 


In this section, we focus on the relationship between the existence of optimal 
feedback operator for Problem (DLQ) (introduced in the last section) and 
the global solvability of the Riccati equation (213). All contents in this 
section are classical. We refer the readers to [193, BUO] for a comprehensive 
introduction on deterministic LQ) problems in finite dimensions. 

The following concept is actually a special case of that in Definition KZI. 
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Definition 13.12. We call O(-) € L?(0, T; R"*") an optimal feedback oper- 
ator for Problem (DLQ) if 


IMOT) € Im ul), V(Gnu() € R” x L°(0,7;R™), (13.19) 


where z(-) solves the following equation: 


dto (13.20) 


dix 
| 7 — (AG) + B9)s in [0,7], 
z(0) =. 

We have the following result: 


Theorem 13.13. Assume R > 0. If the Riccati equation (L313) admits a 
global solution P(-) € C([0,T];S(R”)), then Problem (DLQ) has an optimal 
feedback operator in the following form 


o() = -R"()B' ()PC), (13.21) 
and ((CX14) holds. 
Proof: Let z(-) satisfy 


n 
z(0) =n. 


dà = NC 
i = (A(t) - BR! B' P)z in [0,T], (13.22) 


Define ü(-) by (L212). Then z(-) is the corresponding state. 
For any u(-) € L?(0, T; IR"), let z(-) = z(-;q,u(-)). By (E13), we have 


(P(T)2(T),2(T))pn — CP(0)n, nr” 
= T | (PBR !B'P-— M)s(t),z(t)g - 2(B' P(t)x(t), u(t))g ]at. 
0 
Consequently, 


d (y) = 5 CP(0)nr)n 


1 T 
= F ( (usu) 4 (PBRA B! Pz, z)gs +2(B" Pz, u)g« dt (13.23) 
0 


f 
- J (R(u+ R! B' Pz),u4 RB! Pz)e dt. 
0 


'This implies 


(P(0)n, mg» € J (m u(-)), 


(10) = 5 
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which concludes that u(-) is an optimal control, O(-) given by (2-21) is an 
optimal feedback operator, and (C214) holds. This completes the proof of 
Theorem TJ. oO 


Since (3-13) is locally Lipschitz in the unknown P(-), it is locally solv- 
able, that is, there exists s < T such that (E213) admits a solution on [s, T]. 
Nevertheless, due to the quadratic term, the global well-posedness is not guar- 
anteed, unless there are some additional conditions. The following result, to- 
gether with Theorem [EE T2, gives an equivalence between the solvability of the 
Riccati equation (£213) and the existence of an optimal feedback operator 
for Problem (DLQ). 


Theorem 13.14. Assume R > 0. If there exists an optimal feedback operator 
for Problem (DLQ), then the Riccati equation (LZTA) admits a unique, global 
solution P(-) € C([0, T]; S(IR?)). 


Proof : The uniqueness of the solution follows from the boundedness of the 
coefficients along with the Gronwall’s inequality. Consequently, we only need 
to show the existence of the solution. 

Let O be an optimal feedback operator for Problem (DLQ). By (CA) 
and (L43), the following de-coupled forward-backward (ordinary differential) 
system: 

dz 


^p Ale + BOF in [0, T], 
2 — —A(t)"y + Mz in [0, T], (13.24) 
z(0) —75, y(T)- -Gz(1), 
admits a (unique) solution (z(-),y(-)) ' € C([0, T]; R?"), and 
a(t) = R !B'y(t) = Oz(t, | te[0,T] (13.25) 


gives an optimal control, where z(-) is the corresponding optimal state. 
Define R"*"-valued functions X(-) and Y (-) by 


X(t)n 2 z(t; n), 


Y (t)n =y(t:n), 


Clearly, (X(-), Y (-)) solves the following matrix-valued forward-backward or- 
dinary differential equation 


V (t,) € (0, T] x R^. (13.26) 


dX — 


» = —A(t)"Y + MX in [0, T], (13.27) 


X(0)=In, Y(T) 2 -GX(T). 
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Consider the following ordinary differential equation: 








dX To 
= ( — A(t)— BO) ' X in [0,T 
a 7i AD pet, (13.28) 
X(0) =n 
Then, 
d (x@x()") 
=0,  Wte (0,7). 
dt 
This implies that X(t)~! = X(t)" for all t € [0, T]. 
From (1325), it follows that 
R'B'Y(t)=OX(t),  te(0T|. (13.29) 
Let 
P(t)4-Y(t)X(t)-!, st € (0, T]. (13.30) 


From (321), (E28) and (13-29), we have 


» --(MX-A(t'Y)X  «Y(X !At)-X BR !B'Yx ?) 


=—M — A(t)! P — PA(t)+ PBR`'B' P. 


This, together with P(T) = G, proves that P(-) is the solution to (L213). 
This completes the proof of Theorem IL3.14l. o 


Remark 13.15. Compared with the coupled forward-backward system (L39), 
due to the assumption on the existence of optimal feedback operator for Prob- 
lem (DLQ), we obtain the de-coupled forward-backward system (324), which 
plays a key role in the proof of Theorem LITA. As we shall see in the sequel, 
this point is also the key for us to characterize the optimal feedback operator 
for Problem (SLQ). 


13.3 Optimal Feedback for Stochastic LQ Problem in 
Finite Dimensions 


In this section, we recall the main results on the optimal feedback for stochastic 
LQ problems in finite dimensions. To this end, we set H = IR", V = R and 
U = R”. The main content of this section are taken from [236), BI]. 
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13.3.1 Differences Between Deterministic and Stochastic LQ 
Problems in Finite Dimensions 


For any 7 € R”, we consider the following control system 
l dz(t) = (A(t)z + Bu)dt + (Cx + Du)dW (t) in [0, T], 
«(0) =n, 


with the quadratic cost functional 





(13.31) 














T 
Iu) = 5B[ | (Ms z)us + (Ru, u)an)dt+ (G2(T),2(T)) ga) 


2 
(13.32) 
where u(-) € L2(0, T; IR") is the control variable, and 


A(-),C(-) e Lg (0, T; R"*"), B(-), D(-) € Lg (0, T; IR), 

M(-) € Lp (0,T;S5(R")), R()eLg(0,7;S(R"), Ge LF, (2; S(R”)). 
It is easy to see that, the system (ILL3I) admits a unique solution z(.) € 
L£(9; C([0, T]; R")) and hence (Z323) is well-defined. 

'The following optimal control problem can be viewed as a finite dimen- 
sional version of Problem (SLQ): 
Problem (FSLQ). For each 7 € R”, find a u(-) € L2(0, T; IR") such that 


Z(na()) = "TS Jm C). 

Similarly to that of Problem (SLQ), one can define the so-called stan- 
dard Problem (FSLQ), and the finiteness and (unique) solvability of Problem 
(FSLQ) (and hence we omit the details). 

Let us recall that, Proposition [3-4 shows the necessity of the condition 
R > 0 for Problem (DLQ) to be finite. The following example, however, 
reveals a completely different phenomenon in the stochastic setting. 


Example 13.16. For m — n — 1, consider the stochastic control system 


















































dx = udW (t) in [0, T], 
(13.33) 
«(0) =n, 
with the cost functional 
1 T 
Fnsu()) = gE(- [ war + n), (13.34) 
2 0 
Then, 
1. [T T 1 pT 
J(mu(-)) = -z af udt + J udt +n? = = f udt +n? > 0. 
2 Jo 0 2 Jo 


Hence, this LQ problem is finite though, in this example, the corresponding 
R=-1! 


488 13 Linear Quadratic Optimal Control Problems 


A necessary condition for the optimal control is given below. 





Theorem 13.17. Let Problem (FSLQ) be solvable at n € R” with (z(-), u(-)) 
being an optimal pair. Then there exists a transposition solution (g(-), Y (-)) 
to 
l dy = —(A(t)'g+C'Y —Mz)dt+Ydw(t) — in [0,T], 5.35) 
y(T) = -Cx(T), 
and a transposition solution (P(-), Q(-)) to 
dP = - (A(t)! P + PA(t) -C' PC - QC - C' Q— M)dt 
+QdW(t) in [0,T], (13.36) 
P(T) =—G, 
such that 


R(t)u(t) — B(t)' g(t) - D(t)'Y(t) 20, a.e. (t,w) € [0,T] x Q. (13.37) 


R(t) — D(t)' P(t)D(t) 20, ae. (tw) € [0,T] x R. (13.38) 


Theorem LIA can be viewed as a special case of Theorem ILL3U, and 
hence we will not prove it here. 


Remark 13.18. Compared with the deterministic case (Proposition [LL4), we 
see that, by (7238), R may be negative. Namely, the necessary condition 
might still be satisfied even if R is negative, provided that the term -DT PD 
is sufficiently positive definite. 


'The following concept can be viewed as a special case of that in Definition 
M. 
Definition 13.19. Any O(-) € LY (2; L? (0, T; IR"*")) is called an admissible 
feedback operator for Problem (FSLQ). Further, it is called an optimal feedback 
operator for Problem (FSLQ) if 


J(mOC)C) € Jis u() V (n, u()) € R” x Ulo, T], (13.39) 
where z(-) = z(-; n, O(-)z(-)) solves 

l dz(t) = (A(t) + BO)zdt + (C + DO)zdW (t) in [0,1], 

z(0) =n. 

Remark 13.20. In the above, we choose O € Lg? (Q2; L?(0,T; R"*")) rather 
than O € LE(Q; L?(0, T; R^*")) for any p € [1,00). This is because we hope 
to keep the control strategy to be robust w.r.t. small perturbations. Indeed, 
under the latter assumption on O (ie., O € LE(Q; L?(0, T; R"*")) for any 
p € [1,oo)), if there is a measurement error dz € L2(62; C([0, T]; R")) with 


[óT] r2 (o; (f0,T];R^)) = £ > 0 for £ being small enough in the observation of the 
state, then one cannot conclude that O(z + óx) is an admissible control. 


(13.40) 
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As in the deterministic case, we shall construct the optimal feedback op- 
erator by means of a suitable Riccati equation. Let us first derive such an 
equation formally. For simplicity, in the rest of this section, we assume that 
F is the natural filtration generated by W (-). 

Suppose that Problem (FSLQ) is uniquely solvable. For any 7 € R”, let 


(z(-),u(-)) be the optimal pair and (g(-), Y (-) the classical adapted solution 
to (£335). It follows from (37) that 


Rü(t) - B'g(t) - D'Y(t) 20, a.e. (t,w) € [0,7] x 2. (13.41) 
Assume that there is an Itó process 
dP = Fdt + AdW(t) (13.42) 
with suitable F and A such that 
g(t) = —P(t)a(t), t € [0, T]. (13.43) 
'Then, by Itó's formula, 
d(Pz) 
= (dP)z + P(A(t)z + Bu)dt + P(Cz + Du)dW (t) + A(Cz + Du)dt 
= —dy = (A(t)! y + C' Y — Mz)dt - YaW(t). 





(13.44) 
Consequently, 


(dP)z = ( — PA(t)t — PBu — Mz + A(t) y+ C' Y)dt — A(Cz + Du)at 
—P(Cz + Du)dW (t) — YaW(t). 








(13.45) 
From (42) and (IELZ3), we see that 
AZ = —P(Cz + Dū) — Y. 
This, together with (C241) and (IELZ3), implies that 
l u--(R4D'PD) (B'P4 D'PC + D'A)z, T. 
yY--Ar— Pr (R+ D'PD)'(B' P4-D' PCs D'A). 
By (2245) and (IEZ48), we have 
dP = —(PA(t) + A(t)! P+ AC +C'A+C'PC 
+M -L'K-'L)dt + AdW(t) in [0, T], (13.47) 


P(T) =G, 


where 
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K=R+D'PD, Lea PAD (PC+ A), 
By (3-46), we see then that, formally, the optimal feedback operator is 


@=-K"L. (13.48) 


We call (3-47) the matrix-valued backward stochastic Riccati equation as- 
sociated with Problem (FSLQ). It is a nonlinear backward stochastic differ- 
ential equation and its well-posedness is highly nontrivial. 

Compared with Problem (DLQ), clearly Problem (FSLQ) is much more 
complicated. Both the well-posedness of (3-47) and the relationship between 
the solution (P, A) and the solvability of Problem (FSLQ) are much different 
from the deterministic problem, for example 


1) The uniqueness of the solution to the Riccati equation (£47) is not guar- 
anteed; 

2) The O given by (2-48) may not be an admissible feedback operator, i.e. 
it may not belong to Lg°(Q; L?(0, T; R™*”)). 


Let us illustrate the above two differences by the following two examples, 
respectively. 


Example 13.21. For m — n — 1, consider the control system 
l dz = (A(t)x + Bu)dt + udW (t) in [0,1], 
«(0) =n, 


with the cost functional 














J(mu(-)) = El - «o? « f (Mz? + Ru?)dt], 
where 442 3 1 
R(t) = (t-5) £420 Ms- 
1r (R(t) — 1)? R(t) - 1 ii 
A0-3[ gp h) BO =F 


In this case, the corresponding stochastic Riccati equation becomes an ordi- 
nary differential equation: 





dP B?p? ‘ 
qp C2A0P M - ug in [0,1], (13.50) 
Pes 


It follows from (249) that 
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2p2 2 2 i u 
BP —2A(t)P — M = (B? — 2A(t))P* — (M + 2A(t)R)P - MR 
|. P? c£ 2P «1 
~ RP 


This, together with (L350), implies that 


dP P?4+2P+1 





= in [0, 1], 
dt R+P 0, 1 (13.51) 
P(1) 2 -1. 
Clearly, 
P\(t)=-1,  te[1] 
and 


P(t) 2t—2, t € [0, 1] 
are solutions to (L451). 


Example 13.22. Define one-dimensional stochastic processes M(-), ¢(-) and a 
stopping time 7 as follows: 





uo [ PELO t € (0,7), 


7 Sint (t € [0,T)| |M(£)| > 1] ^ T, (13.52) 
A 


e(t) — t € [D,T). 


qt 
——— Xp, t), 
ayay T aXe 


By some direct computations, we have 





T T 1 
x | vT- ae (13.53) 


T 
< —— 


p (saws) 


and 














afew ( f KOKI m (13.54) 


Consider the following backward stochastic differential equation: 


T 21 T 
iti f CGdW() 5 +1- f Z(sdW(s,  t€ [0,7]. 


This equation admits a unique solution 


z(t) = f ¢(s)dW(s) + 3/5 +1, Z(t)=¢(t), a.e. t € [0, T]. 
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From ([L3.52)- ([L3.54]), it is easy to see that 
[cate 
v2 (13.55) 
Z() € Le (2; L7(0,T)). 


Consider a standard Problem (FSLQ) with the following setting: 


m=k=1, A)=B=C=0, Dei 


1 1 (13.56) 
M=0, R=->0, G-z(T)!--»0. 
4 4 
For this problem, the corresponding Riccati equation reads 
dP = (R + P) 1 4?dt + AdW (t) in [0,1], 
(13.57) 
P(T) =G, 
and O(-) = -(R + P(-)) 1A). 
Put " 
P() 2 P() +R, ASA 
It follows from (IE) that 
dP = P-1/?ds + AdW(s) in [0, T], 
= (13.58) 
P(T) = xT). 


Applying Itó's formula to z(-)~!, we deduce that (P(-),AC)) = (z()^!, 
—2(-) ?Z(-)) is the unique solution to (58). As a result, 


(PC), 49) $6)! — R,—()?Z()) 


is the unique solution to the Riccati equation ([LL57). Moreover, O(-) = 
—z(-) 1 Z(-). By (C55), we see that O(-) does not belong to Lg? (2; L?(0, T). 
Hence, it is not an admissible feedback operator. 


13.3.2 Characterization of Optimal Feedbacks for Stochastic LQ 
Problems in Finite Dimensions 


From Examples [[3-21] and [L£22, we see that neither the well-posedness of 
the matrix-valued backward stochastic Riccati equation (LZA) nor the exis- 
tence of the optimal feedback operator is true even for a standard Problem 
(FSLQ). Nevertheless, we have the following result which gives the equiva- 
lence between the well-posedness of the equation (LZZ) and the existence of 
optimal feedback operator for Problem (FSLQ). 
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Theorem 13.23. Assume that Problem (FSLQ) is standard. Then, this prob- 
lem admits an optimal feedback operator O(-) € Lg? (R; L? (0, T; R”*”)) if and 
only if the matrix-valued backward stochastic Riccati equation (LIZZI) admits 
a solution (P(-), A(-)) € LẸ (2; C([0, T]; S(IR"?))) x L2(0, T; S(R")) such that 








K»0 13.59) 
and 
K()71L() e Lg (0; (0, T; R"*")). 13.60) 
In this case, the optimal feedback operator O(-) is given as 
O(-) = -K(-) !L(.). 13.61) 
Furthermore, 
usé PT J(mu)-— 5 UP (n. nm. 13.62) 


Proof: The “if” part. Assume that the equation (L247) admits a solution 
(P(),A()) € Lg (05;C([0, T]; S(R"))) x L2(0, T; S(R^)) such that (E0) 
holds. Then, it is clear that the function O(-) given by (61) belongs to 
Le (Q; L?(0, T; IR"*")). For any 7 € R” and u(-) € L2(0, T; R"), let z(-) = 
z(-;m,u(-)) be the corresponding state process for (E31). By Itó's formula, 
and using (C331) and (IZZ), we obtain that 


d Paus 
= (dPz,z),, + (Pdz,z),, + (Pr, dz), 
t (dPdz, Dies + (dPz, dias + (Pdz, da) ei 


= ( — (PA(t)+ At) P + AC-C'A-C' PC M- L' K^ D)o, x), dr 
H(P(A(t)z + Bu), z),, dr + (P(Cz + Du), z),, dW (r) (13.63) 
(Pz, A(t)z + Bu), dr + (Px, Cx + Du),,dW (r) 
H(A(Cz + Du), DM „dr + (Az, Cz + Du), dr 
+(P(Cz + Du), C + Du), dr + (Az, 2) gn dW (r) 

( 

( 

( 








= —((M — L' KHL), x), dr + (PBu,),, dr 
+(Pa, Bu) ga Or + (PCs, Di) dh + (PDu, Cx + Di) se dr 

gn dr + (Az, Du), dr + (P(Cx + Du), z)g« dW (r) 
+(Px,Cx + Du)ga dW (r) + (Ax, z)4, dW (r) 

= —((M — L' K L)a, a), dr + 2(L"u,2)gedr + (D! PDu, u)pmdr 
-[2(P(Cz + Du), x)g» + (Az, x)g» |dW (r). 














From the definition of O in (E2138), we derive that, 


O'KO--O'KK !L-L'K-L. 
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This, together with (L363), implies that 
d(Pz,z),, = —((M — O' KO)z, x),, dr + 2(L' u,2)gndr 
+(D' PDu, u)gn dr + [2(P(Cz + Du), t)pn (13.64) 
(Az, z)g» ]dW (r). 





To handle the stochastic integral above, we introduce a sequence of stopping 
times (7;] 52, as 


t 
7; int [1 20 | i; | A(r)?dr >j} ^T. 
0 


It is easy to see that 7; > T, a.s., as j — oo. Using (£554), we obtain that, 


























T 
E(P(rj)a(r;), v(15))g + : Xpo.r;] (Mz, a) am + (Ru, u)gm ]dr 























T 
= E(P(0)n, ne +E I Xio; (8  KOx, zje + XL u, pn] dr 
0 

















T 
4 J Xi. ] (R + D PD)u, u)gs dr. 
0 
Clearly, 
|(P(7;) (73), x(;))gl < |P| rg: (orp) |21Z2¢0,0((0,7)9R"): 
By the Dominated Convergence Theorem, we obtain that 


lim (P(rj)a(rj), z(r;))u = (P(D)2(T), (T). (13.65) 


joo 
Furthermore, 
|X, (Mz, x) + (Ru, ua. ]| 
< |[(Mz,2)pn + (Ru, u)r] | € L&(0, T; R). 


By the Dominated Convergence Theorem again, we get that 














joo 


T 
im E f xps [(M2, r)ne + (Bu, t) ]dr 
a (13.66) 


T 
€ ef | (Mz, x)gs + (Ru, ujra] dr. 


Similarly, we can obtain that 
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joo 


T 
lim J X[0,7;] (O! KOz, z)pn + 2(L! u, x)gs ]dr 
0 














T 
+ lim J X[o,z, (( + D! PD)u, u)pmdr 
joo 0 


(13.67) 

















T 
= J [(O' KOz, x)n» + 2(L'u,2x)pn|dr 
0 














T 
+4 J ((R -- D' PD)u, u)gndr. 
0 


It follows from (IEZ63)-(IEL67) that 
23 (m u()) 




















T = 
= E(Ga(T), z(T))g» + Ji [(Mz, z)g» + (tu, ujra | dr 




















T 
= E(P(0)n, n)g» + J [(' KOz, zx)g» + 2(L  u, x)g» + (Ku, u)gm| dr 
0 

















T 
=E KPO, n) T +f (Bee OE. = 2(K Ox, u) Ed (Ku, u) em) dr] 














T 
= 27(n; Ox) + J (K(u — Oz), u — Ox) ant 
0 


where we have used the fact that L! = —O' K. Hence, by K > 0, we get 
I (OZ) < (mu), Yul) € L£(0, T; R”). 


Thus, the function O(-) given by (E2138) is an optimal feedback operator for 
Problem (FSLQ). This completes the proof of the "if" part of Theorem ZZA. 


The “only if" part. Let us divide the proof into three steps. 

Step 1. Let O(-) € Lg? (£2; L?(0, T; IR"*")) be an optimal feedback op- 
erator for Problem (FSLQ). Then, by Theorem [LET4 for any ¢ € R”, the 
following forward-backward stochastic differential equation 


dx = (A(t) + BO)zdt + (C + DO)zaW (t) in [0, T], 
dy = —(A(t)! y - C'Y  Mz)dt - YdW(t) in [0,7], (13.68) 
z(0-—6,  y(T)-Gx(T) 





admits a unique solution (r(-),y(-), Y C-)) € L2(0;C([0, T]; R")) x L2(Q; 
C([0, T]; R?)) x L2(0, T; R”) such that 


ROx+Bly+D'Y=0, ae. (t,w) € (0,T) x 2. (13.69) 


Also, consider the following stochastic differential equation: 
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pa [- A(t) - BO + (C + DO) °] ‘edt — (C + DO) dW (t) in [0,T], 


(0) — G, 
(13.70) 
which has a unique solution 2 € L2(0; C([0, T]; R")). 
Further, consider the following R"*"-valued forward-backward stochastic 
differential equation: 


dX = (A(t) + BO)Xdt + (C+ DO)XdW(t) in [0, T], 
dY = -(A(t)' Y - C' Y + MX)dt + YdW(t) in [0,7], (13.71) 
X(0) =I,, Y(T) = GX(T) 

and R”"*"-valued stochastic differential equation: 


dX = | — A(t) - BO + (C + DO)”| ' Xat 





—(C + DO) ' XdW (t) in [0, T], (13.72) 
X(0) = In. 


Equations (LZM) and (L272) admit, respectively, unique solutions (X, Y, 
Y) e L2(05 C([0, T]; R^*?)) x L2(60; C([0, T]; R^*")) x L2(0, T; R?*") and 
X € Lg (2; C([0, T]; R^*")). 

It follows from (IEZGN) to (IEL72) that, for any G € R”, 


z(5C) - X()c, y(50) 2 Y(06 e) =E vte [0,7], 


(13.73) 
zti = Y (t)C, a.e. t € [0, T]. 
By (E269) and (£73), we find that 
ROX+B'Y+D'Y=0, ae. (t,w) € [O, T] x 2. (13.74) 


For any €, p € R” and t € [0, T], by Itó's formula, we have 
Cup) dO oe — pe 


-f ( (A(t) + BO)z(r; C), &(r; p)) pn dr 


«f ((C + DO)z(r; C). i(r; p)) pn dW (r) 





zb 





+ | (x(r3¢), | A(t) — BO 4 (C DO) T(r; P)}gadr 
x (x(r3¢), (C + DO)" (r; p)),,, dW (r) 


= ((C + DO)x(r; 6), (C + DO) 's(r; p))g. dr 


= 0. 
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Consequently, 
(X(06 X(t)p)yg, = (250), (6 P)) pn = (Gs P) pn aS: 
This implies that X(t)X(t)" = Ip for all t € [0, T], a.s., that is, X(t)" = X(t)? 
for all t € [0,7], a.s. 
Step 2. Put 


A 


P(t,w) ÊY, AX, w), Ht, w) 5 Y(t,u)X(t,u)"^, teo, T]. (13.75) 


By Itô’s formula, 





dP= { — (A(t) TY + CTY + MX)X^! + YX! [(C + DO)? — A(t) — BO] 


-Yx-i(0 + pe) Sat + |vx-! oq De) dW (t) 





= { — A(t)’ P- CTH - M + P[(C + DO)? — A(t) — BO] 
ane pe) dt + [n — P(C + De)|dWwit). 
Let 
A2 1I — P(C 4 DO). (13.76) 


Then, (P(-), A(-)) solves the following R"*"-valued backward stochastic dif- 
ferential equation: 


dP = —[PA(t)+ A(t)'P+AC+C'A+C'PC 
+(PB + C' PD + AD)O + M]dt + AAW(t) in [O,T], (13.77) 
P(T) =G. 





By Theorem ÆA, we conclude that (P, A) € L (9; C([0, T]; R”*”)) x L2(0, T; 
R=”), 

For any t € [0,T) and y € L3}, (Q;R”), let us consider the following 
forward-backward stochastic differential equation: 


dz'(r) = (A(t) + BO)z'dr + (C + De)z'dW(r) — in |t, T], 
dy'(r) = —(A(t)"yt + C'Y* + Ma*)dr + Y'aW(r) in[t,T], — (13.78) 
gen yt(T) = Gr (T). 


Clearly, the equation (IZ) admits a unique solution (z'(.),y'(-), z*()) € 
L2(2Q; C([t, T]; R")) x L2(0; C([t, T]; R^)) x Lz(t, T; R^). Also, we consider 
the following forward-backward stochastic differential equation: 


dX'(r) = (A(t) + BO)X'dr + (C + DO)X'AW(r) in [t, T], 
dY'(r) = — (A(t)' Y! - C  Y* + MX)dr + Y'aW(r) in [tT], (13.79) 
X'(t)—1I, Y'(r)-GX'(T). 
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Likewise, the equation (IEL79) admits a unique solution (X'(-), Y*(-), Y*(.)) € 
L2(0; C (|t, T]; R^*")) x L2(0; C([t, T]; R^*")) x L2(tT;R"*"). It follows 
from (ILL78) and (CZ) that, for any n € LZ, (Q; R?), 
z'(r)-X()m w()-Y(m Yre f,T]. 
(13.80) 
Y'(r) = Y'(r)n. a.e. r € [t, T]. 


By the uniqueness of the solution to (E268), for any ¢ € R” and t € [0, T], 
we have that 


'Thus, 
Y'()X(t)c = y EXA = Y(t)G a.s. 
This implies that for all t € [0, T], 


Y'(t) = Y(X(t) ! = P(t), as. (13.81) 


Let n, € € L*. (Q; R”). Since Y*(r)n = y'(r; m) and X'(r)£ = z'(r; €), applying 
It’s formula to (x'(-), y! (-))g», we get that 


RAE, P(t)n)Rn 


T 
= E(GX'(T)n, X' (T)£)g» + ef (MX, X'£)gs dr (13.82) 
t 






























































T T 
-e | (BOX'£, Y'n)gsdr — f (DOX'£, Y'n) pndr. 
t t 


This implies that 






































E(P(t)n, £)g» = E(GX' (T), X (T)&)n» + E T ((MX*n, X'£)gs 
T(ROXn, OX'£)ns)dr. 

Therefore, 

E(P(t)n, E)r» 


T 
= (£, X*(L)"GX"(T)n + J [G7 MX'n + (X) 6" ReX'n]dr)... 
t 






































which concludes that 


























Pe) =R(xteryTaxt(ny +8 f [oxy TQx! + oye" ROX ar 


t 





A). 


This, together with the assumption that Problem (FSLQ) is standard, proves 
that 
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P(t) 20, as, Vte [0,7]. (13.83) 
Clearly, (P', AT) satisfies that 








dP' =—[P'A(t)+ A(t)'P'+A'C+C'A'+C'P'C 
+0'(PB+C'PD+AD)'+M]dt+A'dW(t) in [0, T], 
P(T)’ =G. 





(13.84) 
According to (LZ) and (3°84), and noting that P(-) is symmetric, we find 
that for any t € [0, T], 


t 
= -f {[4C + C A+ (PB - C' PD + AD)O] 
0 


[AC +CTA+(PB+C™PD+AD)6]"}dr (13.85) 





, T 
+f (A— A )dW(r). 


The first term in the right hand side of (L383) is absolutely continuous with 
respect to t, a.s. Hence, [s (A- AT )dW(r) is absolutely continuous with respect 
to t, a.s. Consequently, its quadratic variation is 0, a.s. Namely, 


T 
f M-A Rands =0, a.s. 
0 


This concludes that 


Alt, w) = A(t,w)", ae. (t,w) € (0,T) x Q2. (13.86) 


Step 3. In this step, we show that (P, A) is a pair of stochastic processes 
satisfying (I2), (IE:59) and (L450). 
It follows from R > 0 and (IECE3) that (359) holds. By (XZ), we get 
that 
B'P+D'T+RO=0, ae. (t,w) € [, T] x 2. (13.87) 


This implies that 











0=B'P+D' [A+ P(C + DO)| + Re 
=B'P+D!'PC+D'A+KO=L+ Ke. 








(13.88) 








From (L259) and (C338), we obtain 
O=-K"'L. 


This, together with the fact that O € LE (N; L?(0,T;R™*”)), leads to (E550). 
Therefore, it follows from (E36) and (LXX) that 
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(PB+C'PD+AD)O=L'@=-0'KO=-L'K"!L. (13.89) 


Hence, by (E272), we conclude that (P, A) is a solution to (E47). This com- 
pletes the proof of the necessity in Theorem [L3.23. L1 


Remark 13.24. By Example LZZ, we see that sometimes it is impossible to 
construct the desired optimal feedback operator by solving the Riccati equa- 
tion (£247). Because of this, we need to introduce the condition (L360). 
Clearly, this is quite different from the deterministic case. 


Remark 13.25. Actually, the condition that Problem (FSLQ) is standard can 
be dropped (e.g., [236]). Nevertheless, in order to present the key idea in the 
simplest way, we do not pursue the full generality in this section. 


Remark 13.26. One can see that the main ideas in the proof of Theorem 
are similarly to the ones in the proof of Theorems and CITA. Neverthe- 
less, the control dependent diffusion term (Cx + Du)dW (t) leads to some new 
difficulty. 


13.4 Finiteness and Solvability of Problem (SLQ) 


In this section, similar to BAO], we study the finiteness and solvability of 
Problem (SLQ). 

Since the state equation (LT) is linear, the state process can be explicitly 
expressed in terms of the initial state and the control in a linear form. Substi- 
tuting this formula into the cost functional (which is quadratic in the state and 
control), one can obtain a quadratic functional w.r.t. the initial state and the 
control. Thus, Problem (SLQ) can be transformed to a quadratic optimization 
problem in the Hilbert space L2(0, T; U). This leads to some necessary and 
sufficient conditions for the finiteness and solvability of Problem (SLQ). Let 
us explain the details below. To this end, we define the following operators: 


For any 7 € H and u(-) € L2(0, T; U), 
F, : L2(0,T;U) > L2(0, T; H), 
(Fyu())C) $a(50,u), V u() € 2200, T; U); 
Fi: L(0, T; U) > L}, (02; H), 
Fyu(-) 22(T;0,u), V u(-) € L2(0, T; U); 
F> : H > I2(0,T;H), 


(Fo()Ez(;m0) Yne H; 
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Fy: H > LL. (0;H), 
Pon £2(Tsn,0), Vn eH, 


where z(-) = x(-;7, u(-)) solves the equation (L31). Then, for any y € H and 
u(-) € L2(0, T; U), the corresponding state process x(-) and its terminal value 
x (T) (for the equation (ILI T)) are given respectively by 


l a(-) = (Fon)() + Fiu)(), 


A (13.90) 


Next, we compute the adjoint operators of Fi, F, Fy and Ey: 
Ft : EQ(0, T; H) > E2(0, T;U), 
Fè : L3, (Q; H) > 20 T. 0), 
Fš 1200, 7: H) > H 
PS (Q; H) > H. 


For this purpose, we introduce the following backward stochastic evolution 
equation: 





hee (4*y +C°Y + £)dt + YdW(!) in (0,7), (13.91) 


y(T) = yr, 
where yr € L3} (9; H) and €(-) € L(0, T; H). 


Proposition 13.27. For any £(-) € L2(0, T; H), let (yo(-), Yo(-)) be the trans- 
position solution to (L) with yr = 0. Then 


l (Ft&)(t) = B*yo(t) + D*Yo(t), a.e. t € [0,T], 
FYE = yo(0). 


On the other hand, for any yr € L3- (2; H), let (ys), Yı(-)) be the transpo- 
sition solution to (TZ) with £(-) = 0. Then 


l (F*yr)(t) = B*y (t) + D*Y, (8), a.e. t € [0, T], 


Fiyr = y (0). 


(13.92) 


(13.93) 


Proof: For any yr € L5. (2; H) a 
unique transposition a rene YC) 
to (EET), which satisfies that 


T 


lecolisdt). 






































T 
sup BOZE | IY get < CE (lets + 
0<t<T 0 


o— 
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for some constant C > 0. Therefore, we know that all the operators defined in 
(E2) and (Y3) are bounded. 


Next, for any 7 € H and u(-) € L2(0,T;U), let z(-) be the solution 
of (L). From the definition of the transposition solution to the equation 


(IUI), we find 











E(z(T), YT) H n 








l 
Gp. 











which implies that 



































E(n, y(0)) z 





F. 
((u(t), B*y(t) + D'Y (t))u — (a(t), £(0) at, 


E((Fan + Fiu, yr) n — (n, (0) x) (13.94) 


T 
=Ë / ((u(t), B*y(t) + D'Y (Hyu — (Fan) (t) + (Fiu)(t), €(t)) z) t. 


Let yr = 0 and 7 = 0 in (L394). We get 


























T T 
E | ((Fiu)(t),€(t)) dt = E (u(t), B*yo(t) + D'Ys(0)udt. 
0 0 


This proves the first equality in (T3792). 
Letting u(-) = 0 and yr = 0 in (L394), we obtain 






































T 
E(n, Fit) = E I ((Fon)(t),€(t)) ardt = Elm, yo(0)) a. 


This gives the second equality in (L492). 
Let 7 = 0 and £(-) = 0 in (BJA). We find that 












































T 
Ji E(u(t), (Ptr) (0) udt = E(Fiu, yr) n 


T 
-E f (u(t), B*yi (t) + D*Y (t) wat. 


This demonstrates the first equality in (L93). 
At last, let u(-) = 0 and €(-) = 0 in (L394). We see that 
































E(n, lyr) a = E(Fon, yr) n = Eln, yi (0)) n. 








This verifies the second equality in (33). o 


From Proposition ZZA, we immediately obtain the following result, which 
is a representation for the cost functional (L33). 
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Proposition 13.28. The cost functional (3:3) can be represented as 











J(mu(-)) = 





T 
Ef (Wu, u)u + 2(H(n),u)y)dt + M(n)}. (13.95) 


N| = 


Here 
N =R+FYMF, + FIGE, 
H(n) = (FE M Fon) (-) + (FrGFa2) C), (13.96) 


M(n) = (M Fan, Fon) + (GFon, Fon) 


L3(0,T;H) LZ (2H) 


As a corollary of Proposition [L3:Z8, we have the following result for the 
finiteness and solvability of Problem (SLQ) . 


Theorem 13.29. 1) If Problem (SLQ) is finite at some n € H, then 
N 20. (13.97) 


2) Problem (SLQ) is solvable at € H if and only if N > 0 and there 
exists u(-) € L2(0, T; U), such that 


Nal) + H(n) — 0. (13.98) 


In this case, ü(-) is an optimal control. 


3) If N > 0, then for any n € H, J(n;-) admits a unique minimizer 
ul) = -NTH (n). (13.99) 
In this case, it holds 


J (m u()) = J(mu(-)) 


inf 
u(-) € L2(0,T;U) 


i (13.100) 
= 5(M( - W^ HG), Hn) orn) — Vn € H. 


Proof: “Proof of the assertion 1)”. Suppose that (97) does not hold. 
Then there is uo € L2(0, T; U) such that 














T 
Ji (Nu0(-), uo(-)) gds « 0. 


Define a sequence (u& 49, C L2(0, T; U) as follows: 
uk(-) = kuo(-) in [0, T]. 


Then 
J (n; ux(-)) — —oo as k — oo, 


504 13 Linear Quadratic Optimal Control Problems 


which contradicts that Problem (SLQ) is finite at 7. 


“Proof of the assertion 2)". The “if? part. Let u(-) € L2(0, T;U) be an 
optimal control of Problem (SLQ) for n € H. By the optimality of a(-), for 
any u(-) € L2(0, T; U), it holds that 


0 < lim 5 (ry aC) + ul) = Gs a0) 


A—0 














qv 
-E l Wal) +H), u(-)udt. 


Consequently, 
Nul) + H(n) = 0. 


The “only if? part. Let (n,u(-)) € H x L2(0,T;U) satisfy (C298). For 
any u € L2(0, T; U), from (IZY), we see 


J(mu()) - Z(mu()) = J(mu() + u() — u()) — Z(m u()) 


T 
= Ji (NEC) + H(n) ul) — W(-)) pat 





ES 



































This concludes that à(-) is an optimal control. 


“Proof of the assertion 3)". Since all optimal controls should satisfy (L498) 
and N is invertible, we get assertion 3) immediately. L1 


Clearly, if Problem (SLQ) is standard, then M >> 0, and by Theorem 
LIZ, it is uniquely solvable and the optimal control is given by (L799). 

There is a main drawback of the formula (L399), that is, it is very difficult 
to compute the inverse of the operator NV. 


13.5 Pontryagin- Type Maximum Principle for Problem 
(SLQ) 


In this section, we shall derive the following Pontryagin type maximum prin- 
ciple for Problem (SLQ). 


Theorem 13.30. Let Problem (SLQ) be solvable at n € H with (x(-),u(-)) 
being am optimal pair. Then, for the transposition solution (y(-), Y (-)) to 
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dy = —(A*y + C*Y — Mz)dt + YdW (t) in [0, T), 
(13.101) 
and the relaxed transposition solution (P(-), QU, QO) to 
dP = -(A*P + PA + C*PC + QC +C*Q -— M)dt 
+QdW(t) in [0,T), (13.102) 


P(T) = -G, 
it holds that 


R(t)a(t) — B(t)*y(t) — D(t)*Y(t) 20, a.e. (t,w) e[0,T] x Q (13.103) 


R(t) - D(t* P(t)D(t) > 0, a.e. (t,w) € [0,T] x 2. (13.104) 


Proof: Since the assumption (S2) in Chapter [is not satisfied, we cannot 
apply Theorem [ZITA to Problem (SLQ) directly. The proof is divided into two 
steps. 

Step 1. In this step, we prove (3-109) by the convex perturbation tech- 
nique. 

For the optimal pair (z(-), u(-)) and a control u(-) € L2(0, T; U), we have 
that 





u*(-) = u(-) + e(u(-) — a(-)) = (1— e)u() + eu-) e E2(0,T;U), Ve c [0,1]. 


Denote by z*(-) the solution of (3-1) corresponding to the control u*(-). It is 
easy to get that 


Ix e«po,r]; L2 (90:2) < C(1 + Inla), Vec [0, 1]. (13.105) 


Write z1(-) = =(2°() — z(-)) and du(-) = u(-) — u(-). Then «{(-) solves the 


following stochastic evolution equation: 





drj = (Axi + Bou)dt + (Cai + Dóu)dW (t) in (0,7), 
{= (Ari + Banja (Coi DII) MOTH Ogg 
xi(s) = 0. 
Since (Z(-), u(-)) is an optimal pair of Problem (SLQ) , we have 
0 < lim 2 5 C) — FH HO) 
£0 2 
(13.107) 























T 
= Ji ((Mz, x7), + (Rū, du), )dt + E(Gz(T), a5 ()) y 





It follows from the definition of the transposition solution to (101) that 
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T 
-E(G(T), a$(T)),, + : (Mz, a5) , di 


T 
E sf ((Bóu, y) y + (Dòu, Y) 9) dt. 


Combining (IELIUZ) and (ILLIUS), we find that 


(13.108) 


























T 
J (Ru — B*y — D*Y,u— u), dt > 0, Vu(-) € L2(0, T; U). 
0 


Hence, by Lemma [IZ.3, we conclude that 
(ROTE) — B(t)*y(t) — D(t)"Y (t),u— u(t)), = 0, fae 
ae. [0 T] x 2, Vu € U. 
This implies (3-103). 


Step 2. In this step, we prove (2104) by the spike variation method. 
For each € > 0 and 7 € [0, T — €), let Ee = [r, r + e]. Let u € L2(0, T; U) 
be such that |@ — u|rz«(o,r,u) < +00. Put 


e ift € [0, T] \ E, 
ut(t) = l (13.110) 
u(t), ift € Es. 


Let x*(-) be the solution to (L3) corresponding to the control u*(-). Consider 
the following two stochastic evolution equations: 


da5 = Aa$dt + (Cx$ + xg, Dóu)dW (t) in (0, T], 
1§(0) = 0 


and 
dx§ = (Ax$ + xg, Bou) dt + Cx$dW (t) in (0,7), 


x3(0) = 0. 
Clearly, z* — Z = x$ + z$. Similar to the proof of (L281), we can obtain that 


l Ix5 res 0,r;r2(2;m)) € CVE, 


(13.111) 
I$ (|Le (or z2 (0:2) € Ce. 


Similar to the proof of (2208), we can get that 
FT (mu ()) — J (m uC)) 


T 
= Ji | (Ma, 2$ + 25) + 45 M25, 25) y 


( 
1 
2 














(13.112) 


exi, ((t6u, ðu)y + z (Ru, ðu)y) dt 


























+E(GE(T), a&(T) + a$(T)) y + 5E(GuS(T), 0$ (T) (9). 
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It follows from the definition of the transposition solution to (L34101) that 


























T 
-E(Gz(T), aS(T)  a$(7)), +E f (MZ, #5 + 15) ,dt 
" (13.113) 














T 
` e f ((Bóu, y) y + (Dôu, Y) po) dt. 


By the definition of the relaxed transposition solution to (3-102), we obtain 
that 


























T 
-E(Gr5(T),25(T)) g +E f (Maj,23) d 


























T T 
-F xe, (Cx, P* Dôu) pdt + E f xz, (PDõu, Ca$) pot 








T 
Ti J xz, (PDóu, Dóu) „odt (13.114) 
0 2 








T 
-HE ri XE, (Dóu, Q9 (0, 0, x E, Dóu)) „odt 
0 2 

















T 
+E ri XE. (QO, 0, xg, Dóu), Dóu) „odt. 
0 2 


From (ILEITI), we have that 


























T T 
Ef X, (C25, P" x, Dóu) podt + ef xe. (Px i, Dou, Cx§) pod! 
= o(). 


Similarly to the proof of (IIZZZ7), one can show that 


(13.115) 














T 
J XE, (Dóu, Q) (0,0, xg, Dóu)) po dt 
0 2 





(13.116) 











T 
+e | xe. (QU (0,0, xg. Dóu), Dõu) podt| 
0 2 
— o(E), as € > 0. 
By (ILIT2)-(IELTTG), we obtain 
J (m u (+) — J(m u()) 














T 
= J xg, (t) (Ru — B*y — D*Y, bu) dt 
0 


























q 
A af XE. ((Rou, du), — (PDöu, Diu) p dt + o(€) 
0 2 
1 T 
= d [ vs. (Ut - DPD) bu, i) dt o 
0 
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Since ü(-) is an optimal control, J (1; u*(-)) — I (y; u(-)) > 0. Thus, 


d. g . 

JE | xz, ((R — D* PD) ôu, ŝu) „dt > o(c), (13.117) 
as € > 0. By (211%), similarly to Step 7 in the proof of Theorem ZI, we 
can show that for all u € U, 


((R- D* PD) u,u) 5 >0, ae. (t,w) € [0,T] x Q, 
which gives (3-104). This completes the proof of Theorem [3-30. Li 


Next, we introduce the following decoupled forward-backward stochastic 
evolution equation: 


dx = (Ax + Bu)dt + (Cx + Du)aW(t) in (0, T], 
dy = —(A*y — Mz + C*Y )dt + YdW (t) in [0, T), (13.118) 
z(0-—m-  y(T)--Gz(T). 


We call (z(-), y(-), Y (-)) a transposition solution to the equation (11) if 
x(-) is the mild solution to the forward stochastic evolution equation and 
(y(-), Y (-)) is the transposition solution of the backward one. 

Since the equation (2118) is decoupled, its well-posedness is easy to be 
obtained. Given ry € H and u(-) € L2(0, T; U), one can first solve the forward 
one to get z(-), and then solve the backward one. Consequently, the equation 
(COA) admits a unique transposition solution (x(-), y(-), Y (-)) corresponding 
to 7 and u(-). The following result is a consequence of Proposition [ELZ71 




















Proposition 13.31. For any (1, u(-)) € H x L£(0, T; U), let (x(-),y(-), Y (-)) 


be the transposition solution to (IZIN). Then 
(Nu + H(n)) (t) = Ru(t) — B*y(t) — D*Y (t), (isa 
a.e. (t,w) € [0, T] x 2. 


In particular, if (xo(-), yo C), YoC)) is the transposition solution to (3.118) 
with n = 0, then 


(Nu)(t) = R(t)u(t) — B(t)*yo(t) — D(t)*Yo(t), a.e. (t,w) € |, T] x 2. 
(13.120) 


Proof: Let (x(-), y(-), Y (-)) be the transposition solution of (IEZTTS). From 
(30), we obtain that 


(Nu + H(n)) (-) 

= [(R+ F} MF;  FEGFAyu] C) + (FEM Fo) C) + rey TNT 
= (Ru)C) + FE M [(Fan)(-) + iu()] + FfG(E2n + Fiu) 

= (Ru)(-) + (Ft Mz)C) + (FfGa(T)) C). 
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By (3-92) and (L393), we know that 

(Fi Mz)C) + (FfGs(T))C) = -B(0*yC) - D(0*Y (). 
This, together with (L120), implies (L9) immediately. At last, (3120) 
follows from (IL 119) as a special case. L1 


The following result (for which the conditions are given in terms of the 
transposition solution to the forward-backward stochastic evolution equation 
(I-LITS)) is an immediate corollary of Theorem [3.29 


Theorem 13.32. Problem (SLQ) is solvable at € H with an optimal pair 
(z(-),u(-)) if and only if the following two conditions hold: 


1) The unique transposition solution (x(-),y(-), Y (-)) to (IIIS) with u(-) = 
u(-), verifies that z(-) = z(-) and 


R(t)a(t) - B(t)*y(t) - D(tY(t) 20, ae. (tw) € [, T] x 2. (13.122) 


2) For any u(-) € L2(0,T;U), the unique transposition solution (xo(-), yo(-), 
Yo(-)) to (IELIIS) with n = 0 satisfies 














T 
f (Ru — B*yo — D'Yo,u), dt > 0. (13.123) 
0 
Proof: The “only if? part. The equality (I:LIZ2) follows from Theorem 
while (£3123) follows from Theorem and (T7120). 


The “if? part. By Proposition [31], the inequality (3-123) is equivalent 
to N > 0. Now, let (z(-), y(-), Y(-)) be a transposition solution to the equation 
CA) such that (£2122) holds. Then, by Proposition [EL3I, we see that 
(3-122) is the same as (L398). Hence by Theorem [L2J, Problem (SLQ) is 
solvable. oO 


Theorem is nothing but a restatement of Theorem [3.29. However, 
when R(t) is invertible for all t and 


R(j- € EY, T; L(U)), (13.124) 


it gives us a way to find the optimal control by solving the following coupled 
forward-backward stochastic evolution equation: 


dt = (Az + BR! B'y + BR! D*Y)at 

+(Cz + DR B*'y-DR !D'Y)daW(t) in (0,T], 
dy(t) = —(A*y + Mz — C*Y)dt + YdW (t) in [0, T), 
z(0—-  y(T)--Gz(T). 


As a direct consequence of Theorem [EZ32, we have the following result. 


(13.125) 
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Corollary 13.33. Let ([3124) hold and N > 0. Then Problem (SLQ) is u- 
niquely solvable atn € H if and only if the forward-backward stochastic evolu- 
tion equation (L125) admits a unique transposition solution (z(-),y(-), Y (-)). 
In this case, the optimal control is given by 


u(t) = R(t) ! [B(t)*y(t) + D(t Y (t)], ae. (tw) e[0, T] x 2. (13.126) 


When Problem (SLQ) is a standard SLQ problem, (£2124) holds and 
N > 0. Consequently, we have the following result. 


Corollary 13.34. If Problem (SLQ) is standard, then the equation (ZIZA) 
admits a unique transposition solution (Z(-),y(-), Y (-)) and Problem (SLQ) is 
uniquely solvable with the optimal control given by (T3120). 


13.6 Transposition Solutions to Operator- Valued 
Backward Stochastic Riccati Equations 


From this section to Section [EZ3, we shall study the relationship between the 
existence of optimal feedback controls for Problem (SLQ) and the global solv- 
ability of the operator-valued backward stochastic Riccati equation (L31). 

Though the equations (ILLI) and (3-47) are in the same form, there 
exists an essential difference between them. Indeed, similarly to the relation- 
ship between the equations (IZA) and (IZU) (in Chapter 12), (IEZTZ) is an 
R”*” (matrix)-valued backward stochastic differential equation (which can be 
easily regarded as an R”’-valued backward stochastic differential equation), 
and therefore, the desired well-posedness follows from the one for backward s- 
tochastic differential equations valued in R”. Also, as mentioned before, there 
exists no such a stochastic integration/evolution equation theory in general 
Banach spaces that can be employed to treat the well-posedness of (C217) in 
the usual sense. 

On the other hand, compared with the linear operator-valued backward 
stochastic evolution equation (ZX), it is clear that (IZI) is a nonlinear 
operator-valued backward stochastic evolution equation with quadratical non- 
linearities. Generally speaking, in order to study the difficult (deterministic or 
stochastic) nonlinear partial differential equations, people need to introduce 
suitable new concept of solutions, such as viscosity solutions for Hamilton- 
Jacobi equations (|G4]) and fully nonlinear second-order equations ([ZI3]), 
and renormalized solutions for the KPZ equation ([L36]). In order to over- 
come the difficulties mentioned above, similarly to Chapter IA, we employ the 
transposition method to study (L&I). More precisely, we need to introduce 
another type of solution, i.e., transposition solution to this equation. To this 
end, let us introduce the following assumptions: 


(AS1) The eigenvectors (ej) 5, of A such that |e;|g = 1 for all j € N 
constitute an orthonormal basis of H. 
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Let {uj;}521 (corresponding to (e;]724) be the eigenvalues of A. Let 
{Aj 12a € (? be an arbitrarily given sequence of positive real numbers. Define 
a norm | - |, on H as follows: 





[hl o. Mlelpughb. "Vhe hee. 
j=1 j=l 


Denote by H, the completion of H with respect to this norm. Clearly, Hj is 
a Hilbert space, H C H) and Os lejoje} is an orthonormal basis of 
Ay. Write Vy for the set of all such kind of Hilbert spaces. 

Write Hý for the dual space of H) with respect to the pivot space 
H = H'. For any Hy € Vy, from the definition of Hy, it is easy to see 
that Duleslp(ayei 524 C Hj is an orthonormal basis of H, and the norm on 
H; is given by 





la, =) 0 alaare = VEE Hy 


where £; = (£, ej) H 
We also need the following technical condition: 


(AS2) There exists Hy € Vy such that C € Lg? (0, T5 L(A); L(V; Hx))); 
M € Lg(0,T; £(H3)), G € LE (Q;L(Ay)) and C € Lg(0,T; L(A); £o(V; 
H5))), M € LẸ (0,T; C(H3)), G € LE, (2; £(H3)). 


Remark 13.35. In (AS2), for C € Lg£(0,T; £C(Hx; £2(V; H3))), we mean 
that for a.e. (t,w) € [0, T] x 2, C(t,w) can be extended to be a bound- 
ed linear operator Cy, (t,w) from Hy to Lə(V; H3) and after the exten- 
sion, Cy, € LR (0, T5 L(A; L2(V; Hy))). For simplicity of notations, we stil- 
1 denote the extension by C if there is no confusion. On the other hand, 
C € Lg (0,T; L(A}; Co(V; H3))) means for a.e. (t,w) € [0, T] x 2, the re- 
striction of C(t,w) on H; (denoted by Cy; (t,w)) belongs to £(H}; L2(V; H1)) 
and Cy, € LẸ (0, T; C(H3; £2(V; H5))). The other notations in (AS2) can 


be understood in a similar way. 


Lemma 13.36. Let Hy € Vy and (AS2) hold. If (S(t))«em is a Co-group 
(resp. Co-semigroup) on H, then it is a Co-group on H3 (resp. Co-semigroup), 
and it can be uniquely extended to a Co-group (resp. Co-semigroup) (also 
denoted by itself) on Hy. 


Proof: We only prove that {S(t)}i>0 is a Co-group on H3. Proofs of the 
other conclusions are similar. 


Let € = 33 leslpta) e; € H5 with {6}, € £^. Then, E= 3:5 
j=1 j=l 
H and |&|g = |€|;. Clearly, 
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(06 = 5 ^ &lejlp(aye"e;- 


j=1 


For any t1,t9 € R, 


8 


S(t3)S(t4)6 = 6 leslpiay$ (t2)S(t1)e; 
nm (13.127) 


Me 


= Do SAslesl ayer Mes = S(ta + 106. 
j=l 


This indicates that {S(t)}:50 is a group on H3. 
For any t9 > tı > 0, 





A 


(S62) — $(41)) él a, = | Y glesta (Sta) - D)e, 





= | do EiAslesl a(ay (e^ —e^5^)e; 


j=l 


= ae" = gau t IS (t2) — S(t1))€| y. 


AY 


This, together with that {S(t)},>0 is strongly continuous on H, implies that 
{S(t)}i50 is strongly continuous on H5. L1 
Next, similarly to Subsection [24], we need to introduce some more con- 
cepts/notations. Beginners may skip this and only consider the case that 
V =R in the rest of this chapter. 
Let {€;}72, be an orthonormal basis of V. Any A € L(L2(V; H3); Ha) 
induces a bounded bilinear functional V(.,-) on H5 x £2(V; H3) as follows: 


0) (A6; Bh) vë) mo VRE Hh, v e La(V; H4). (13.128) 
j=l 


Here, 6; ® h is defined by (ZIX) (Clearly, 6€; & h € Lo(V; H5), and therefore 
A(é; & h) € Hy). " 
Define a bounded linear operator A: H5 — £L2(V; Hy) as follows: 


V(h,v) — (Ah, v) p (vin, ) es (V; HL) Vhe Hi, v € Lo(V; H5). 


It follows from (IE-34]) that 


(Ah; 9) ety taii) = 26; & h),véj) p. gr; TS 


Yh € Hi,v € Lo(V; Hj). 
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On the other hand, any A € £(H};£2(V;H)) induces a bounded linear 
operator A: £2(V; H3) > Hy as follows: 


A( Y ij €i & hj) a x ai; (Ah;)éi, V aij € C with Y la;;l? « oo. 


i,j=l ij=1 i,j-1 
7 (13.130) 

Clearly, if A € £L(Lo(V; H3); Hy), then 
A(v @h) =(Ah)v, | V(v,h) € V x Ah. (13.131) 


In this case, we say that A induces an operator A € L(L2(V; H^); Hy). 

Now, suppose that A € C(Co(V; H3); Hy) induces an operator Ae L(A}; 
Lo(V;Hy)) and A induces an operator A € L(L2(V; H^); Hy). Then, A = A. 
Conversely, suppose that A € L(H}\;£2(V;Hy)) induces an operator Ae 
L(Lo(V; H1); Hy) and A induces an operator A € £(H^; C3(V; H3)). Then, 
A . 


We shall need the following result. 
Proposition 13.37. Any € € £3(V; C9(H3; Hy)) induces (uniquely) an op- 


erator A € C3(C3(V; H3); Hy) and an operator A € C3(H5; L(V; Hx)) satis- 
fying (ŒE) and 


A(v & h) = (Ev)h, V (v, h) € Hy x H. (13.132) 
Moreover, 


IAles(ea (vis y) + lesa ues vim € ClElesviesan imo 


Proof: As in (238), we define a linear operator A from £o(V; H3) to Hy 
by 


A( D Qj; €i ® hj) E » ai; (Z6;)hj, V Qij € C with D lai;l? « oo. 


jal 1,2—l 4,j—1 


By £ € L(V; Co(H5; Hy)), it is easy to check that A € £2(Co(V; H3); H3) 
and 

IAlescea cvi) € ClElestvies rim 
Then, A induces a bounded linear operator Ae Lo(H}; L2(V; Hy)) satisfying 
(L130) and 

[Alca Gr cav;m) € ClAlce(to(V3H4); Ha): 
This completes the proof of Proposition [L34. Oo 


Now, let us consider the following two (forward) stochastic evolution e- 
quations: 
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[^ = (Am + u;)dr (Cz * vi)dW(r) in (t, T], (13.133) 
zit) = 
and 
= (Azo + us)dr + (Cv + v2)dW(r) in (t, T], (13.134) 
z2(t) = &. 


Here t € [0, T), £1, €2 are suitable random variables and u1, u2, v1, v2 are suit- 
able stochastic processes. 


By Lemma and Theorem ELZU, we obtain the following result imme- 
diately. 


Corollary 13.38. Let (AS1)-(AS2) hold. Then, for j = 1,2, for any £j € 
L5, (0:H5), uj) € Lp(Q;L7(t, T; H3)) and vj) e L&(25 L? (t, T; La(V; H1))), 
the mild solution x1(-) (resp. xə(-)) to (ILLA) (resp. (ZIZA) ) belongs to 
Cx([t, T); L* (£2; H3)). 


Put 
Cr, ([0, T]; L° (0; £(H))) 
B [Penn | P(t,w)€ S(H), ae. (tw) € [o T] x 2, |P(-)| cur € Eg? (0, T), 
and P(-)¢ € Cg([0, T]; L® (2; H)), VC € H} 


and 
Lg, (0, T; £(H)) 
2 [4e LÀ(0, T; £3(£o(V;H1);H3))|D* A € V(U; H), a.e. (t,w) €[0, T] x 2). 


Now, we introduce the notion of transposition solution to (L217): 
Definition 13.39. A pair of operator-valued stochastic processes (P(.), A(-)) 
€ Cr, ([0, T]; L® (2; £(H))) x Dg, (0, T; L(H)) is called a transposition solu- 
tion to (IELT2) if the following three conditions hold: 

1) K(t,w)( = R(t,w) + D(t,w)*P(t,w)D(t,w)) > 0 and its left inverse 
K(t,w)~! is a densely defined closed operator for a.e. (t,w) € (0, T] x 2; 

2) For anyt € [0, T], £1,6£ € L5, (0; H5), u1(), ua) € Lg (2; L^ (t, T; H5) 
and vi(-), va(-) € LECO; L? (t, T; £3(V; H3))), it holds that 


























T 
E(Gai (T), vo(T)) g |J (M (7)ax (7), v2 (7)) dr 














T 
-E | (Kt) 10i), Lre) ur 
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T 
= E(P(t)€1, 2) 4 + eh (P(r)ui(7), x2(7)) dr (13.135) 


a 
En f^ (A(T) vi(r),za(T nim gj, dT 


cdi 




















T 
ux(r)) dr + Ji (P(r)C(r)m(r), va(7)) pdr 


nu 











C(r)za(T) + v2(T)) god 




















va(r 7) ccv; Hx),£a(V; Ht 





QS 


where A(-) is the operator induced by A(-), and 2;(-)(resp. x3(-)) solves 
(I3) (resp. (ZIZA) ); 9 and 

3) For any t € (0, T], &,& € L}, (2; H), ui(), us) € Dg(t, T; H) and 
v1), va(-) € L2(t, T; U), it holds that 


























T 
E(Gai (TD), xo (D)) a + J (M (r)ax(r), v2 (7)) ydr 














T 
-E | (Kt) (rar), Lerma (0)) utr 

















T 
= E(P(t)&1, E2) y + f (P(r)ui(7), zxa(7)) dT (13.136) 
































T T 
+ f (P(T)z1(T), us(7)) dr - Bf (P()C(r)m (7), D(7)v2(T)) pdr 











T 
4E f (P(r)D(r)v1 (T), C(r)gs (7) D(7)v2(7)) gdr 


























T T ^, 
+E I (A(r)D(r)v1(7), va(7)) dr E | (D(* A(r)m (7), 22(7)) yar. 


Here, xı(-) and x2(-) solve (IEZT33) and (IET34) with vı and v2 replaced by 
Dv; and Dv», respectively. 


13.7 Existence of Optimal Feedback Operator for 
Problem (SLQ) 


In this section, we shall prove the existence of optimal feedback operator for 
Problem (SLQ), provided that the operator-valued backward stochastic Ric- 
cati equation (IET 7) admits a transposition solution. To this end, we should 
introduce the following assumption. 


? By Theorem BU, one has 21(-), z2(-) € LER; C([0, T]; H3)). 
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(AS3) Let (o;)5&4 be an orthonormal basis of U. There is a ÜcU 
such that U is dense in U, {pj}fi, C U, R € Lg(0,T;£(U), B € 
Lg (0,1; £(U; H3)) and D € LẸ (0, T; C(U; Lo(V; H3)), where Hy is given 
in Assumption (AS2). 


Theorem 13.40. Let (AS1)-(AS3) hold. If the operator-valued backward 
stochastic Riccati equation (IZT) admits a transposition solution (P(-), A(-)) 
€ Cr, ([0, T]; L® (2; £(H))) x Lẹ w(0, T; £(H)) such that 


K() ! [BO* PC) + DO POCE) + DAO] € NH; U) N d ae 
13.13 
then Problem (SLQ) is uniquely solvable and admits an optimal feedback oper- 


ator O(-) € T2(H;U) n T2(H3;U). In this case, the optimal feedback operator 
O(-) is given by 


Furthermore, 
uy aao Miis = 300. mn. (13.139) 


Proof: Let us assume that the equation (ILLT7) admits a transposition 
solution (P(-), A(-)) € Cr,,([0, T]; L® (2; £(H))) x Lg, (0, T; £(H)) such that 
(L137) holds. Then, 


0 2-K-(B*P + D*PC + D*A) € %(H;U)NYo(Hi;U). (13.140) 





For any t € [0, T), n € L}, (2; H) and u(-) € LẸ(0, T; U), choose £i = & = n, 
uj = Ug = Bu and v = v2 = Du in (BBJ). From (I8), (IE T3) 
and the pointwise self-adjointness of K(-), we obtain that 


























T 
(Gs (T). (T) +E | (MO) atr) ur 
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Then, by (13:3) and (IEEI4I), recalling the definition of L(-) and K(-), we 


arrive at 


i "n ((Mz(r),2(7)) y + (Ru(r),u(r))y )dr F (Gar) (7) 















































T T 
= E( P(t), m), + J (PBu(r), x(r)) „dr + J (Pa(r), Bu(r)) ydr 




















" T 
4 Bf (PC2(r), Du(r)) podr + J (PDu(r), Cz(r) + Du(r)) gdr 




















ae T — 
+E f (ADu(r), x(r)) ydr + E f (D* Ax(r), u(r))ydr 























T T 
+ J (0* KOz(r), x(r)) ydr + J (Ru(r), u(r)),, dr 


T 
=E (Pn, n)a «f ((&* Kextr), (7) + 2(La(r), u(r))j 
+(Ku(r),u(r)) ,) ar]. 


This, together with (3-138), implies that 
































(f. ((Ma(r),2(r)) y + (Rul), u(r)),,)dr  (G(7) 007) 





T 
Py (Pen, n) y «f ((KOxz, Ox) —2(KOz,u) + (Ku, u)v)dr| 

















T 
E((P(t)n, es | (K(u — Oz),u — 02), dr). (13.142) 


By taking t = 0 in (BIZ), we get that 




















J (m u()) 
1 T 
= E|(P(0)n, iu +f ((KOz, Ox) -2(KOz, u), + (Cu, u)v) dr] 
(13.143) 
= : (G0), f (K(u — 62), u — 62), dr) 














T 
= J (m 02) «se (K(u — Ox), u — 6x), dr. 
0 


Hence, 
J(mOz)XJ(mu, Vu()e L£(0, T;U). 


Consequently, O(-) is an optimal feedback operator for Problem (SLQ), and 
(C139) holds. Further, since K > 0, we know that the optimal control is 
unique. This completes the proof of Theorem KZZ. LI 
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13.8 Global Solvability of Operator- Valued Backward 
Stochastic Riccati Equations 


Theorem ILEAU in the last section concludes the existence of optimal feedback 
operator for Problem (SLQ) under the assumption that the operator-valued 
backward stochastic Riccati equation (21M) admits a transposition solution 
satisfying (L137). In this section, we shall show that the converse of this 
theorem is also true under some more conditions. 

The main result of this section (together with Theorem [34), which re- 
veals the relationship between the existence of optimal feedback operator for 
Problem (SLQ) and the global solvability of (17%) in the sense of transpo- 
sition solution (See Definition [L3WJ), is stated as follows: 


Theorem 13.41. Let (AS1)-(AS3) hold and A generate a Co-group on 
H, and let F be the natural filtration generated by W(-). If Problem (S- 
LQ) is uniquely solvable and admits an optimal feedback operator O(-) € 
%2(H;U) 9 Yo(H}; U), then the equation (ZTA) admits a unique transposi- 
tion solution (P(-), A(-)) € Cr, ([0, T]; L^? (2; £(H))) x Dg, (0, T; L(H)) sat- 
isfying (LZIZA) and the optimal feedback operator O(-) is given by (T3138). 
Furthermore, (I:LT39J) holds. 


The proof of Theorem LZA] is quite long, and will be given in the Sub- 
section [LLS-2, after some careful preliminaries presented in the Subsection 
3-8-1 


Several remarks are in order. 


Remark 13.42. In Theorem CZA, we only conclude that K(t,w) has left in- 
verse for a.e. (t,w) € (0, T) x 2, and therefore K(t,w)~! may be unbounded. 
Nevertheless, this result cannot be improved. Let us show this by the following 
example. 

Let O C R* (for some k € N) be a bounded domain with a smooth 
boundary 00. Let H = Hi (O) x L7(O), V = R, U = L? (O) and A= x i : 
where A is the Laplacian on O with the usual homogeneous Dirichlet boundary 


2) 2=0 M=0, R= (=A) and G =0. 


condition. Let B = a) C= f 


Then (CZT) is specialized as 

dx = (Ax + Bu)dt + CxdW(t) in (0,T], 

(13.144) 
x(0) = m. 


The cost functional reads 














1 (p 
EAC ee Ef ((-A)-tu(t), u(t)) jo dt. (13.145) 
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Clearly, for any y € Hj(O) x L?(O), there is a unique optimal control u = 0. 
For the present case, it is easy to check that (P(-), A(-)) = (0,0) is the unique 
transposition solution to (ELT). However, K = (—A)~? is not surjective and 
K-1 is unbounded. 


Remark 13.43. In Theorem LZA, we assume that A generates a Co-group 
on H and F is the natural filtration generated by W(-). These assumptions 
are used to guarantee the well-posednss of the stochastic evolution equation 
(C279) in the sequel. Actually, the Co-group condition can be dropped (See 
[235] for the details). 


Remark 13.44. By Theorem BZU, if £j € L% (Q; H5), uj() € Lg(t, T; Hh) 
and vj(-) € L2(t, T; C3(V; H4)), then the solutions x; (j = 1,2) to (IELTT3)- 
(CZI) belong to L2(£2; C([t, T]; H4)). This plays a key role in Step 5 in the 
proof of Theorem [34]. We believe that this assumption can be dropped. 
However, we do not know how to do it at this moment. 


Remark 13.45. In Theorem [341], the most natural choice of optimal feed- 
back operator should be an element in Y2(H;U) rather than an element in 
Y%(H;U)N Y3(H3;U). Nevertheless, at this moment, in the proof of Theorem 


IZA, we do need to suppose that O(-) € Y2(H; U) Y Y2(H3;U). 


In this rest of this section, unless otherwise stated, we assume the assump- 
tions in Theorem L34]. 


13.8.1 Some Preliminary Results 


In this subsection, we present some results for the approximation of stochastic 
evolution equations and backward stochastic evolution equations by stochastic 
differential equations and backward stochastic differential equations, respec- 
tively, which will be useful in this section. Besides proving Theorem ZÆ, we 
believe that these results have their own interest. 


First, for any 7 € H, consider the following stochastic evolution equation: 





[^ [(A + A)x + f]dt + (Bx + g)dW(t) in (0,T], (13.146) 


x(0) =. 


Here A € N(H), B € T3(H;£$), n € H, f € L2(Q;L1(0,T;H)) and g € 
L2(0, T; £9). By Theorem BZU, we know that the equation (I314G) admits a 
unique mild solution z(-) € L2((2; C([0, T]; H)), and 
Ix [rz (oco, z 
g(Q2:C([0,7]; H)) (13.147) 
< C (Ila + [Fl L2(2;L1(0,T;H)) + lg| r2(0,7:2)- 


Next, we consider the following backward stochastic evolution equation: 
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ru (A*y + DY + h)dt +YdW(t) in [0, T), (13.148) 


y(T) = €. 
Here € € L5, (0; H), D € LẸ (0, T; (C$; H)) and h € LẸ(0, T; H). By Theo- 
rem Æ, we know that the equation (148) admits a unique mild solution 
(y), Y C)) € £&(0; C([0, T]; H)) x L800, T; £2), and 
ly), Y CIzzto;e(o, mz) x12(0,7c2) € C (Ilr (0.20) T lhl r2 (o,7.2)- 


For each n € N, denote by I» the projection operator from H to the finite 


dimensional space Hy, 2 span 1«j«nlej) (recall that (e; 75., is an orthonormal 
basis of H). Let 


An —ISAIS, An —IVAIS, Bn =InBIn, Da =InPIn, 


(13.149) 
Gn =InGIn, fa = Inf, 9n = Ing, hy = Inh. 
It is easy to show that 
lim An = Ac, lim Bng = BC, 
for all ¢ € H and a.e. (t,w) € [0, T] x 2, 
lim D,¢ = DG, 
led (13.151) 
for all Ç € £9 and ae. (t,w) € [0,T] x Q, 
lim Gn = GG,  forall G € H and a.e. w € R, (13.152) 
n—oo 
lim fn =f, lim hy=h in L2(0,T;H), 
n—oo noo 
(13.153) 


lim mu am Z(0,T; £9). 
n— oo 
For any € € D(A), 
lim |A4£ — At|g = lim |I, ATs£ — A£|g 
TL,— 0o "n—oo 
< lim |I; (AT€ — A£)|g + lim |(Is — I) A£|n 
noo n—00 
< Jim ((AI5£ — A£)|g + Jim IL, — FA 
< Jim [Alecom 6 — Eloa + Jim (I5 — P) A£|g = 0. 


By the Trotter-Kato approximation theorem (e.g. |E7 page 209]), we have 
that, for any ¢ € H, 


lim e^"'( = S(t) in H, uniformly for t € [0, T]. (13.154) 
n—-oo 

Similarly, we have that for any G € Hy, 
lim e^^"!t = S(t)C in Hy, uniformly for t € [0, T]. (13.155) 
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Lemma 13.46. Let (AS1) hold, and Hy € Vy. Then A € £3(H; Hy) and 
Jim |An — Alc; (H;Hy) = 0. 


Proof: Since {e;}92, are eigenvectors of A, it holds that 


oo 


Yo esl, = Y welin = » , Nuleilpa € 3, < o. 
j=l j=l j=l j=l 
Hence, A € £L2(H; Hy). 
Next, 


oo 


Jim |A, — Ale, 0) = Jim, do IMn = Adeslin, 
j=l 


oo oo 
g 2,2 =2 : 2 
uu 25 Queis qu. D. ape 
j=n+1 j=n+1 


This completes the proof of Lemma [C3461 o 


Now we introduce sequences of stochastic differential equations and back- 
ward stochastic differential equations, which approximate the stochastic evo- 
lution equation (149) and backward stochastic evolution equation (2143), 
respectively. 

For any 7 € H, € € L5,(Q;H) and n € N, consider the following two 
equations: 








" = [(An T As), f] dt | (Biz H gn) dW (t) in (0, 17, (13.156) 
and 
dyn = — (Až Yn + DnYn + hn) dt + Y4dW in [0, T], 
í y. = - (Atv )at © OT oiu 
Yn(T) = In. 


Lemma 13.47. For any n € H and € € L7. (Q; H), it holds that 





lim E( sup |z,(t) — z(t)]4;) = 0, 
noo t€[0,T] 














lim E( sup |yn(t) — w(t)zr) = 0, (13.158) 
nee t€[0,T] 


lim |¥n(-) — Y (J[zz(o,r;co) = 0- 


n— oo 





Proof: Step 1. In this step, we prove the first equality in (3-153). 
Put 
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A 
M sup |S(t)lcan (Alcan + IBlecreo) 
tc[0,1] 
and let to € [0, T] satisfying that 


to £ max {t € (0, TJ max{t, t?) < (13.159) 


ue) 
From (IELT4G) and (£2155), we have that 


E( sup |an(t) — 2(t)|%) 
tE[0,to] 


























2 
«CE sup (|s()n = eA" rag 
tE[0,to] H 


1 t 
+ i S(t — r)Ax(r)dr — n ean 677) A, s (r)dr 
0 


t 2 
+ [5 S(t —r)f oar- f e^ f, (r)dr| 
0 H 
2 


E [ S(t — r)Ba(r)dW(r) — | e^» 07B, zn (rd (r)| 


t 2 
d t — r)g(r)dr — | eA gi (r)d 
[5 S(t — r)g r f e gn(r) wil) 


Let us estimate the terms in the right hand side of (L160) one by one. 
First, 


(13.160) 














sup |S( (tn — e^"! r; anl 














t€[0,to] 
<2 sup |S(t)n — e^t? +2 sup [efrin — e^t ra. 
t€[0,to] t€[0,to] 
Ast, |? N 2 
<2 sup |S(t)n— e^" n|j + CE|n — Tang (13.161) 
t€[0,to] 


Next, from the definition of A, and An, we know that 
(S(t) —e*^.4, 20, — vte [0,7]. (13.162) 


'Thus, we have 


t t 2 
i S(t — nAx(rdr— f An Anas (r)dr|. 
0 

t 
[5 S(t — r).Av(r yar f eAn(t—") A, z(r)dr 
0 


t 2 
[ oat - [ en (77) A, an (r)dr 
0 0 H 

















E sup 
t€[0.to] 








< 


NO 





E sup 
t€[0.to] 























+2E sup 
t€[0,to] 








(13.163) 
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< m [(S(t-r)— eAn(t—)) A E (S(t—r) = en (77) A, ]z(r)| ydr 


+M’ E sup |a(t) — a DE 
t€ [0,to] 























to 
«2 e (S(t —r)— gas Ax(r)| dr 
0 











+M?#E sup |x(t) — rnt. 
t€ [0,to] 





Using (132162) again, we get that 


















































t 2 
E sup [5 S(t — r)f(r)dr M e^ f, (r)dr| 
tE[0,to] 0 H 
t 2 
< 2E sup [5 S(t — r)f(r)dr — f e^ (0 f(r)dr]| 
t€ [0,to] 0 H 
t 
+2E sup [ ean (7n) f(r)dr — ^ ean (t7) f. (r)dr (13.164) 
tE[0,to] ' JO 0 


























Oe A, (t—r) 2 f” 2 
<æ f |(S¢-r)- e^ Jade ec f fer) = fal) ladr: 


By Theorem (Burkholder-Davis-Gundy inequality) and (3162), we 
have that 
























































t t 2 
E sup | S(t — r)Bz(r)dW (r) — | e^ (77), y (r)dW (r) 
tE[0,to] | Jo 0 H 
i t 2 
<2E sup I S(t—r)Bx(r)dW (r) -f ean 7D B, v (r)dW (r) (13.165) 
tE[0,to] | Jo 0 A 
t t 2 
+2E sup j eAn(t77B, r(r)dW (r) -f ean t=) B £n (r)dW (r) 
tE[0,to] | Jo 0 H 


























to 
<2 J (S(t —r)— c^» 0-7)Bz(r) |^, dr +M HE sup |a(t) — x4 (t)|2; 
0 2 















































t€[0,to] 
and 
t 2 
E sup [5 S(t — r)g Kis e^ (0g, (r)aW(r) 
t€ [0,to] 0 H 
t 2 
<2E sup [5 S(t — r)g(r)aW (r) — n e^n = g(r)a (r)| (13.166) 
t€ [0,to] 0 H 
t 2 
+2E sup ri Moni. e^, (raw) 
te[0,to] ' Jo 0 H 


























to to 
<2 J |(S(¢- r) — e^» *7?)er) |o. dr +C J lr) — nr )lagar. 
0 ° ° , 


524 13 Linear Quadratic Optimal Control Problems 


From (2-159) to (LLI680), we find that 











E( sup |sn(t) — rlr) 



































t€ [0,to] 
< e( E sup |S(£— $)n — ettn] + Bly Tal 
t€ [0,to] 
to 
" af (S(to — r) — e^» t7?) Az(r)| , dr (13.167) 
0 




















to to 
F af (S(to — r) — e^» t7" ) fr) [dr a Ji Mr) — frd 
! 0 








to 
+ e f (S(to —r)— eg An (to-r )Ba(r) [zs dr 



































to i 
` ner 2 . 
+E | (S(to — r) — e^ )9(r)| gar + E | le(r) — gn(r) lear). 


For all n € N, 


2 
sup |S(t)n — e^"'n|,, € Cln- 
t€[0,T] 


This, together with Lebesgue’s dominated convergence theorem and (L40), 
implies that 






































2 
lim E sup |S(t)g — e^"! 
noo t€(0,T] | ( ) lu As ie 
=E lim sup |S(t)n — e4ntn |Z, =0. . 
N° 4€/0,T] 
Similarly, we can prove that 
lim E[n — D,u|;, = 0. (13.169) 


n— oo 


Next, noting that for all n € N, 
(St-r)- en 7) Ax(r) |, < C|z(r)[;., a.e. (t,w) € [0, to] x 2, 


it follows from Lebesgue's dominated convergence theorem and (C2150) that 














to 
im E — p) — eA (tor) ? dr = 13.170 
Jim E f l(S(to—r)—e )Ax(r)|;, dr = 0. ( ) 
Similar to the above arguments, we can show that all the terms in the right 
hand side of (L167) tend to zero as n tends to oo. Consequently, we obtain 
that 














lim E( sup |z,(t) — x(t)|%,) = 0. 


^99  'tel0,tg] 


If to = T, then we complete our proof. Otherwise, let 
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t; Smax [t€ to, T] max{t — to, (t — to)2} < DE} (13.171) 


Repeating the above argument, we get that 











lim E( sup |£n(t)— x(t)|z) = 0. 


^99 * t€[0,t1] 





By an induction argument, we can obtain that 











lim E( sup |zn(t) — x(t)|z) = 0. 


tee "4610, 7) 





Step 2. In this step, we prove that the second and third equalities in 
(C215) hold. 

Denote by o(A*) the spectrum of A*. Since A* generates a Co-semigroup 
on H, there exists Cg > 0 such that 


sup {Rep} < Co. (13.172) 
pea(A*) 


Recall that the eigenvectors {e; }?°2, of A constitutes an orthonormal basis of 
oo 


H. For any £ — X &e € D(A), we have 
k=l 


Re (46, €) = Re ( Yankee, Y Erer) < Coltli- (13.173) 
k=1 k=1 


For each u € p(A*), let R(u) = u(uI — A*)-. Introduce respectively the 
approximating equations of (148) and (IELT37) as follows: 

dy, = —A*y,dt — dt 4- Y,dW (t) in [0, T), 

l : ^ (ORAY A (13.174) 


Yu (T) = R(u)&, 


l dyn, = ~A} Yn, u — Ta R(u)(DnYn + hn)dt + Yn dW (t) in [0, T], 
Yna (T) = I,R(u)I3£. 

(13.175) 
By Theorem AIA, we obtain that 
uL (Yn — Ynlz2(a:c((0,7]:H)) + |Ynu — Ynlzae,r;c9)) — 0 — (13.176) 


and 


ii, (lun — vlz2co;cqo;r + Yu — Ylr20,r;29)) = 0- (13.177) 
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By Itó's formula, (E2173) and noting Ayn. = AnYn,, as well as ([ELT72), we 
have 


T 
lus (D) — vnu (OB + f Yur) — Yn (r)legdr 
ZA 
= |R(uy — P, R() Enel + f CTE T a — (rand 
T 
" f (R())DY (r) — TaR(H)DnYn (v), Yul) — goa (r)) ndr 


(qu 
+ f (RODA) = PaRin) ur) — mar) (13.178) 





aq 
$ f (alr) — Ya (0)dW(r), yul) — vaal) 
T 
< [Ry — PaR(u)Patly + Co j lus (r) — Yel) Bear 
T 
d f (R()DY (r) — TaR(u)Dn Yn (v), Yul) — goa (r)) ndr 


T 
" f (R(u)h(r) — T Ra) hs(r) gu (n) — a a (r)) acd 





T 
" f (alr) — Yo (0)dW(r), yul) — 9r) 


Letting y > oo in (EITA), from (BIA) and (IM), using Burkholder- 


Davis-Gundy inequality, we have 


























q 
Ely(t) — v (DI +E | IY — Yalegdr 
t 



















































































T 
<E sup W- voll +E | Y- Yalegdr 
alee f (13.179) 
T 1 T i 
< EE- rdi +CE fly —anlhrar+ SE f Y- Yalgdr 
t t 
T 
«f Ih — hal dr. 
t 
This, together with Gronwall’s inequality, implies that 
T 
Slut) - wf +E f IY- Yalegdr 
f (13.180) 


























T 
< C(I- Tagh +B f h- hber). 
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From (3-180), we see that 


























T 
lim ( sup Ely(t) — y»(t)[2, + e| IY - Y, |esdr) =0. (13.181) 
0 


n—>co \ tE[0,T] 


By the second and third line of (L179), and using (IELISI), we obtain the 
second and third equalities in (153). Li 


Consider the following stochastic evolution equation: 
l dai, = (Artin + Tuy) dr + (Cita + Tavı)dW (T) in (0, T], 


Zi, nls) = Iné. 
(13.182) 
Similar to Lemma [EL47, we can establish the following result. 


Lemma 13.48. For any & € L}, (Q; H3), ui(-) € Lg(Q2 EPO, T; H\)) and 
vi(-) € Le(Q; L7(0,T; £3(V; H3))), the solution z1,,(-) € LECOQ; C([0, T]; H3)) 
to (LX182) satisfies 


Jim |zis C) = 21C)iz4ca,cco,ria)) = 9 (13.183) 


where x1(-) is the solution to (TZI33). 


For a.e. 7 € [0, T], define six operators 9, Bn, V, Wn, Z and E, as follows: 


(On)(r)=2(7), Vn ed, 
d : H > IO OD T]; H)), 
loe VncH, 
v : H > L£(0;C([0, T]; H)), 
ARMEN VncH, 


a ee 

















Wn : H > L2(2;C((0,T]; H)), 
(Wan) (T) = Yn (T), VEH, 


F : H > ES T; £$), 








(En\(7)=Y(r),  VmeH, 


and 
En : H — L2(0, T; £5), 


(Ean) (T) = Yn(T), YEH. 


Here z(-) (resp. &n(-)) is the solution to (E3148) (resp. (EX158)) with f = g = 
0, (y(-), Y ()) (resp. (ys C), Yn(-))) is the solution to (LZI49) (resp. (IL3-I52 T) 
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with A and € replaced by Kx for some K € LẸ (0, T; C(H)) and Ga(T) (resp. 
hn and £n replaced by K,,z,, with Kn = I4,KI5 and Gaz, (T)), respectively. 

Denote by Inn, the embedding operator from H to Hy. We have the 
following result. 


Lemma 13.49. Suppose A € N (Hz), B € Y3(Hx; £9(V; H3)), D € LZ (0, T5 
L(L2(V; HX); H3)) and K € LẸ (0, T5 L(Ay)). Then, 


Jim Mam Pn — Inn Plrscoicqomica unu) = 9 (13.184) 


um Hu Vs — Inn,V|rstoioqoTica ar) = 0 
(13.185) 
im. [Inm En — Inm, |uscoue (ome aries = O 


Proof: We first prove (E2184). It is easy to show that, for any o € LẸ (0, T; 
L? (0; Hy)), 
Jm |Ano — Aolra(a;11(0,7;H,)) = 0. 
l (13.186) 
im [Bno — Be|rsqoiro (o rcs (aseo (V 85))) = O- 


From the definitions of 9 and $,, we see that, for any 7 € H and t € [0, T], 
t 
&(t)n = S(t)n «f S(t — r)A(r)Ó(r)ndr 
0 


+f S(t— r)B(r)B(r)ygaW(r) in H, a.s., 
0 
and 


t 
&, (t) = e^! Dag + ni eA» (77 A, (1) 8, (r)ndr 
0 


t 
E | e^nlt-d B (r), (r)ndW(r) in H, as. 
0 


Noting e^! Tan = e^^!n, we have 


Typ, ®(t)n = Iny, S(t)n + f Igy, S(t — r)A(r)ó(r)ndr 
(13.187) 


t 
+f Iug,S(t— r)B(r)$(r)ndW(r) in Hy, a.s. 
0 
and 


t 
IHH, Pn (t)n = IHH, e^ntn + I IHH, ean 77) An (r)o, (r)ndr 
0 


t 
+f Ing, e^" Bn (r)ó,(r)pdW(r) in Hy, as. 
0 
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Since Igp, e; = ej for all j € N, if O € L(A) can be extended to a bounded 
linear operator on H5, then 


Ing, O = Ole teas = 5 | Litt, Oc; = Olum eslir, 
j=l 


8 


=> |Oe; — Oe; lir, =0. 


j=l 


Consequently, Igu, O = Ofg g,. This, together with (L2187), implies that 
Igy, P(t) = Ing,S(t)n + f S(t = r)A(r) Inn, d(r)ndr 


+ [ se ose r)Inn,P(r)ndW(r) in Hy, as. 


Since £2(H; H3) is a Hilbert space, for any t € [0,7] and a.s., 


Inn, &(t) = Inn, S( d^ S( t—r)A (r)ng,d(r )dr 
(13.188) 


Similarly, we can prove that for any t € [0, T] and a.s., 


t 
Tin, P(t) = Ing, e^"! «f eAn C7) A, (r) Ln, s (r)dr 
" (13.189) 


+ [APB (rn Pnlr)dW (7) in £a Hx). 
0 


In what follows, to simplify notations, we omit the operator Ipp, if there is 
no confusion. 

It follows from (IZISA) and (C2189) that for any stopping time 7o with 
To(w) € (0, T], a.s 


























E sup |$(r) — $,(r) 
"c ong] | Lea ris) 
^ r|4 
«CE sup |IS() - e^" i anm) (13.190) 
r€ [0,70] : 
T 4 
+ S(r — 1) A(t) (7) — e^- An (7) Pn(7)) d 
[ Ge- 04090 -e (sra, s 


+ 





a (S(r — 7)B(r)®(7r) — e^^(077B, (7), (r)) aW (7) 





4 
vo i 
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Hence, by Burkholder-Davis-Gundy inequality, and noting that |.A,(-)| e(z,) < 


[ACen as well as |Bs-)|e(nes(vins» € IBO)Leanscestv;n) we deduce 
that 























E sup |$(r)— $,(r 
Wem | PTPR 
«c[e( su st) - e% iana) 
eed | [anm ) 














(S(To — T)A(T)— en =D A, (r)) G(r) 








"Fen (o77) A, (7) (G(T) — By (r)) 





4 
dr) 
E£2(H;H) 


(S(ro — 7) B(r) =e 0*7? B, (7))9() 

















^ n 
«i 
TO 
«(f 
2 2 
An(To—7) — 
+e B,(7) (P(r) $,(r)) — o | 


<¢|B( ee) e^" ran) (13.191) 
T STO 


+ (f. (ST — DA) - 57A, (08) 


4 4 
+(| AO lean) PEET PEN + BC) Lean ses v) Ig coa) 


xE( sup |®(r) — 9, (r)[5, orn) 
r€[0,7o] 





























4 
dr) 
£L2(H;H)) 





























+ (f |(S(T — 7)B(7) - pP OB NGO) enea) j 


Noting that A € T1(H4) and B € T3(Hx; L2(V; Hy)), we conclude that there 
is a stopping time 7 € (0, T], a.s., such that 


TO 2 2 1 
e(| | AC eaat atlf |B lenses" | pera) s 2 


For this 7o, it follows from (IEZTUU) that 














E( sup |®(r) — 9, (r)| crm) 
r€[0,7o] 











< clE( sup |S(r)— e^" | unm) 
T € [0,70] 


T (13.192) 
f (S(T -AA eA eldr] 





. 
+E 











L2(H;H)) 

















i e( T KST — rae (77? B, (7))9(7) enemmn) | 
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From (23-154), we have 


lim E( sup |S(r) — e^" [A arg) =0. 


n 00 r€[0,To] 
By (02154) and (C2185), we get that 


4 











lim E 
n—-oo 





f , (S(T — r)A(r) — e^” 07A, (7))ó(r)dr 
0 








£2(H;HA) 


and 














n—- Co 


T 2 
PE: by 2 
lim E( I (StT.—7)B() -e^* 7-78, E) aremm] 79. 
These, together with ([2192), imply that 
Jim |On — 9| sore (0,7;L2(HsHy))) = O- (13.193) 


Repeating the above argument gives (IZISA). 


Next, we prove (C2184). Clearly, for any o € LQ (0, T; L?(Q; H)) and 
9 € Lg? (0, T; D? (0; La(V; H»))), 


Jim Kno — Kelrss(o,;z2(0:23)) = 0, 
(13.194) 
Jim [Prd — Dolte 0,7;12(2;H,)) = 0- 


Similar to the proof of (IEZISN), we obtain that for any t € [0, T] and a.s., 


T 
W(t) = S(T —t)* Gb(T) + / S(r — t)* (K(r)W(r) + D(r)(r))dr 
" i (13.195) 
-f S(r — t)“ E(r)dW (r) in £Lo(H; Ay) 


and 


T 
V, (t) = e^ T -9 G, 6, (T) «f ort (Kn(r)Yn(r) +Dn(r) En (r))dr 
- t (13.196) 
-f eAn—-9 E (r)dW(r) in Lo(H; Hy). 
t 
Since £3(H; H3) is a Hilbert space, by (13195)-(L4I90), it is easy to see 
that (W,5) and (W,,=,) are respectively weak solutions of the following 
£2(H; H))-valued backward stochastic evolution equations 


dw = —(A*V + KV + DE)dt + EdW (t) in [0, T), 
(13.197) 
Y(T) = GO(T) 
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and 


di, = — (A$ n + K,V, + D, Z,)dt + Z,dW(t) in [0, T), 
(13.198) 
V. (T) = Go, (T). 


Then, for any t € (0, T], by Itó's formula and noting that (A* — AZ)U, = 0 
(by our assumption (AS1)), 


T 
PO- Oant f E0- 5E orcum tr 
"[ 
= |G9(T) — G,9,(T Msn; mt? *(V — Wn), V — Dn Vesti H3) 


t 


Mm yw, Y — Yn) p La(HiHy) T Ti Yn), Y — Vs) p 1:125) 
+((D — D,)E,V — Up) + (Dr (E — En), V — Vn) 





L(A; m) t Lo(H; jJ dT 


T' 
-2 f (E EE =a) ire aes: (13.199) 


Since A* generates a Co-group on H5, we have that for any o € Lo(H; Ay), 


oo oo 


(A* 0, 0) coru.) = y A" (oes), Oek) Hy € Cy. leerlin = Clota) 
k=1 k=1 


Thus, 
T T 
J (AW - 5), Da) uuu yr SC f |Z — V, [^ (rg, dr. (13.200) 
t t 
Clearly, 
T 
f (Cs — Wn), E — Yn) esra dr 
T 
«f (D,(E — Ey), V — V.) , (i dr 
i 
2 
< Kalero f |Y — Pale (gig y dT (13.201) 


T 
HD.lp oras, f |v = V, cm) zi Zalea eav y d7 


T T 
2 1 — 212 
«cf w- e aar 5f IE — Enl rares any dn 


From (ILISJ)-(IEL2UT]), we find that 








T 























T 2 
V (t) — V, (HaC: m) *: «(f sue E (rares ydr) 
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Q 











T 2 
< s[Icecr - 6. mun, + È f lE — Gales aradr) (13.202) 


«QU (K - KW. ant) + (f° KP - Da) 044,4) | 


Since 
2 














PETIT 


(f lez Dn) Bl agt) ] ziii 


the estimate (202) implies that 














i E 4 
E E33 i Z(t) ~ Pn (t) lear) 
(13.203) 














T 2 
«(f |Z(r) - Er) ones un d) | =0. 


This gives the second equality in (3-185). 
It remains to prove the first equality in (T3185). From (ILLIUS) and 
(C2196), it follows that, for any so € [0, T), 














E sup |W(r) — V, (r)| e, (HH) 
r€[so,T] 








« CE sum [isr —r)' Gé(T) — e^s(T G8. (TIS cuiu) 
re€iso, 





4 


T 
4 f (S(r u r)* Kr) (r) ES e^ C79 K, (m), (r))dr| (13.204) 


£2(H;HX) 


4 


T 
d / (S(T — r)*D(r)&(r) — e^» 7? D, (r) ,(r))dr 





L2(H;Hy) 











T 4 
i y (S(r — r)*B(r) - e^ ME, (r)) dW (7) Leal 


Therefore, by Burkholder-Davis-Gundy inequality, similar to (ZIM), we ob- 
tain that 





x 


H 











sup |V(r)— V, (r)a orn) 
r€[so,T] 


«c[k sup |S(T - Ger) - e^ (076,9, (T5 agr) 
reo, 




















(13.205) 





HBC | [tren - ear) HC) 


3| |4 7 4 
*(T = so) |K] zp orean! rele T] Fr) Mere) 





4 
dr) 
£2(H;HÀ) 
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+E( [ (SEDO) - 4 Da) EO uad) 





= — 
— 


4 S 
+([P| Ee (orsc(Ca(VsHy)s Hy) ii 1) Benne) ` 


E 
Let so = T—(2C|K[7 2 (0,7;c(H,))) 3. Then C(T—59)*|K[5 se (or. e (10) = 
By (3153), (C184) and (L42039), we conclude that 


Jim [Yn — Plico; Le (so seo (1:83) = O- 


Repeating this argument gives the first equality in (3-184). L1 


'To end this subsection, we provide below a controllability result concerning 
the trajectories of solutions to (E134), which is a variant of Lemma 
and will play an important role in the proof of the uniqueness of transposition 
solutions to (IELT7). 


Lemma 13.50. The set 








2 f29(-) | x2(-) solves (IELT3d) with t = 0, £y = 0, v2 =0 
and uz € Lg(£2; L'(0, T; H3))] 
is dense in L2(0, T; H4). 


Proof: The proof of Lemma is very similar to the proof of Lemma 
[LZ T3. We give it here for the sake of completeness. 

If Lemma were not true, then there would be a nonzero p € 
L2(0, T; Hy) such that 














T 
e f (p, z2) g, y, ds =0, for every z2 € PA. (13.206) 


Consider the following backward stochastic evolution equation: 
dy = —A*ydt + (p — C*Y )dt + YdW (t) in [0, T), 
l ( ) (13.207) 
y(T) = 0, 
which admits a unique solution 
(y), ¥(-)) € Le(2; C([0, T]; Ha)) x Le(0,T; Ha). 
Hence, for any ¢1(-) € L1(0, T; L4(Q; H3)) and ¢2(-) € L2(0, T; L^(2; H4)), 


we have 


T 
-E f (21s), 0(8) - CY (9) nds 














(13.208) 


























T T 
= J (1 (5) u(5)) py gj, ds + J (é2(5), Y (5) pe , ds, 
0 0 
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where z(-) solves 


l dz = (Az + ¢1)dt + ó3dW (t) in (0, T], 
(13.209) 


z(0) — 0. 





In particular, for any x2(-) solving ([240) with t = 0, & = 0, v = 0 and an 
arbitrarily given uz € L2(0, T; H3), we choose z = x2, ¢ = u2 and à» = Cz. 
It follows from (3-208) that 





























T T 
-E (za(s), p(S)) y, gy, d5 — E (ua(s), ()) pe y, 35, 

0 dH 0 AH (13.210) 
V uz € L&(0, T; H3). 


By (210) and recalling (T3205), we get that y(-) = 0. Consequently, 
(3-208) is reduced to 


























Tq T 
2 i (2(8), p(s) — C*Y (3) y. ds = Ji (é»(5), Y (9)) y. ds. 
(13.211) 
Choosing ¢2(-) = 0 in (IEZZUJ), by (IEZZII), we obtain that 


m s 
E 1 ( i S(s — 0)¢1(0)do, p(s) — CV) o gaa 
V bi(-) € Lp(0, T; L*(Q; H5)). 














Hence, 
[5 S(s — e) [e(s) — C*Y (s)]ds = 0, Vø € [0, T]. (13.213) 


Then, for any given Ao € p(A) and c € [0, T], it holds that 
(13.214) 


Differentiating the equality (L214) with respect to e, and noting (IEZZT3), 
we obtain that 
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(Ao — A)? (plo) — C*Y (e)) 
T 
J S(s — 0) AQ — A) (p(s) — C*Y (s))ds 


Therefore, 
a) = corvo. (13.215) 
By (£2275), the equation (X27) is reduced to 


dy = —A*ydt + YdW (t) in |0, T), 
l RRR (13.216) 


y(T)=0. 


It is clear that the unique solution of (L420) is (y(-), Y (-)) = (0,0). Hence, 
by (2.215), we conclude that p(-) = 0, a contradiction. This completes the 
proof of Lemma B50. L1 


13.8.2 Proof of the Main Solvability Result 


In this subsection, we shall prove Theorem [L.4T. To avoid the beginners being 
trapped in the technical details, we only handle the case that V = R, that is 
W(-) is a standard one dimensional Brownian motion (Note that, in this case, 
LS = RQH is isometric isomorphism to H. Hence, in the rest of this chapter, 
we simply regard £3 as H). With the preliminary results in Subsection LZR, 
interested readers can follow the proof in this subsection to deal with the 
general case. The proof (even for the case V = R) is so long that we have to 
divide it into several steps. 


Step 1. In this step, we introduce some operators X(-) B, Y(-), Y(-) and 
Let O(-) € Y(H; U)NT(H!; Ü) be an optimal feedback operator of Prob- 
lem (SLQ). Then, by Theorems B20 and Æ, for any ¢ € H, the following 
forward-backward stochastic E ara equation 
d$ = (A+ BO)ádt + (C + DO)2dW(t) in (0, T], 
dy = —(A*y  C*Y + M£)dt + YdW(t) in [0, T), (13.217) 
$(0 =ç, w(T)-G&(T) 
3 [n the sequel, we shall interchangeably use X(t), X(t, ), or even X to denote the 
operator X(-). The same can be said for Y(-), Y(-) and X(-). 
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admits a unique mild solution (#(-), y(-), Y (-)) € L2(0; C([0, T]; H)) x L2(Q; 
C([0, T]; H)) x L2(0, T; H) such that 
ROĉ + B*y + D*Y =0, ae. (t,w) € (0, T) x R. (13.218) 


Further, consider the following stochastic evolution equation: 


di = | — A — BO + (C  DO)'|'adt 
-(C + DO)' idW (t) in (0,T], (13.219) 
#(0) — c. 


Note that A generates a Co-group, and hence, so does —A*. By The- 
orem B20, the equation (Z219) admits a unique mild solution Z(-) € 
L$(0; C([0, T]; H)). 

For each n € N, denote by I the projection operator from U to 
U, 2 span i<j<n{¥j} (Recall that (;]j2, is an orthonormal basis of U). 
Write = = 

Be] Hr. C270, m lp. 


M,-2I,MI, Rn=InRIn, On = MOD. 





Clearly, 
lim Cn = CÅ in H, 
n— +00 
lim MaC = MÅ in H, 
d (13.220) 
lim On = OC in U, 
n—:4-oo 
for all ¢ € H and ae. (t,w) € [0, T] x Q, 
and 


lim Bys = Bs in H, 


n4 oo 
lim Dns = Ds in H, 
NFOS (13.221) 
lim Rans = Rs in U, 
n— 4oo 
for all ç € U and ae. (t,w) € [0, T] x 2. 
Consider the following forward-backward stochastic differential equation: 
dên = (An + BnOn)êndt + (C, + DnOn)êndW (t) in [0, T], 
dyn = —(Af yn + C; Ya + MnZn) dt + Y,dW (t) in [0,T], — (13.222) 
$,(00 = Ink,  yn(T) = Gnên(T) 





and the following stochastic differential equation: 
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di, = [— A, — BnOn + (C, + D,O,)] ndt 
—(C, + DnO@n)' Zn dW (t) in (0, T], (13.223) 
(0) =In¢, 
where A, and Gn are given in (IÆ). For each t € [0,7], define three 
operators Xn, Yn, and Xn, on Hn as follows: 








Xn, Tat £ 4 (t5 Ind), 
Yn Ta £ ys (t; 4C), VCEH. (13.224) 
X. I6 E (5 Ing), 
For a.e. t € [0, T], define an operator Y, on Hn by 
Yn alat E Yalt; Tal), VCE. (13.225) 
By the well-posedness results for the equations (T3222) and (IEL223), and the 


fact that both A and —A* generate Co-semigroups on H (because A generates 
a Co-group on H), we see that 


Xn Tn Clr, (aH) S ClCla, 
Y, ln L3} (Q;H) < Cila, 
Yn, Is6lrz(o m; < Clelia, 


Xn, Talr (aH) S ClCla, 








where the constant C is independent of n. This implies that 
Xn tl n| cH, (ou) S C 


Y»aDIleiuizz (0) € 6 
i (13.226) 


Ya.com) S C 








Xn tl nlc HL, (QH)) S C- 

Consider the following equations: 
dX, = (An + Bn On)Xndt + (Cn + DnOn)XnadW (t) in [0, T], 
dY, = —(ARYn + C; Ys + MnXn)dt+YndW(t) in [0,7], (13.227) 
X,(0 = n, Yn(T) = GX, (T) 


and 
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dX, = [- A, — BnOn + (Cn + D,O,)] Xndt 

—(C, + Dn@n)'XndW(t) in [0, T], (13.228) 
Xn (0) = In- 
Clearly, both (32227) and (IEZZZ8) can be viewed as R”*” = R""-valued equa- 
tions. By Theorems and ÆTI, the equations (227) and (LZA) admit 
solutions (Xn, Yn, Yn) € L2(0;C([0, T]; R^*"?)) x L2(2; C([0, T];R"*")) x 
L2(0, T; R"*") and Xn € L2(0; C((0, T]; R^*")), respectively. It follows from 
(L:772 (1778) that, for a.e. t € [0, T], 

Xn In = X4(01AC, 


Yn tlre = Yalt C, 

VCEH. (13.229) 
Yatak = Y (t)IAC, 
Xon = X De. 


Thus, 
X, In € Li, (Q; C(H)), 


) 
Ys aD € L5. (0; £(H)), 
Xa. € L5. (0; £(H)), 

) 


Yn Tn € L2(0, T; L(H)). 
Clearly, 
XI, € Lpa(H; L}, (2; H)) for a.e. t € [0,T], 
Ys I5 € £ya(H; L}, (2; H)) for a.e. t € (0, T], 
Xn In € Lpa(H; L2. (Q; H)) for a.e. t € [0, T], 


Yn, In € Leal H; £7 (0, T; H)). 

By (3-226) and using Theorem 2.63), we deduce that, there exist suitable 
subsequences (X, 19551 C {Xna jnen {Yne ther C {Yn etre {Ynt} ke C 
(Y44129.4, and (X4,4)224 C {Xn}, (these sequences may depend on t), 
and (pointwise defined) operators X(t,-), Y(t,-), X(t,-) € £ya( H; L3- (2; H)) 
(for each t € [0, 7]) and Y(-,-) € C,4(H; L2(0, T; H)) such that 


lim Xn, In, = X(t,-)G weakly in L2 (£2; H), 
k— +00 t 


lim Yn, In, = Y(t,-)¢ weakly in L2- (£2; H), 
k—-roo z 


' uu (13.230) 
m Ya, = Y(-,-)¢ weakly in L2(0, T; H), 
—-4oo 





lim Xn, 415,6 — X(t,-)¢ weakly in 12. (Q; H), 
k—-roo i t 
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and that 
X(t, )6lza. (0:8) < C\Clx, 


Y(t, Cina, (2;H) < C\Clx, 
Y (.)Glzz(o,ran < lela, 
X(t, Cl. (o. < Clclar- 


On the other hand, from the definition of (4n(-;In€), yn (5 IC), 
and £4(:; nC), by Lemma LZA, we have that 











Jim 2,(5I50) = (50) in LEC; C(O, T]; H)), 
Jim yni Tae) = y(56) in LECO; C(O, T]; H)), 
Jim Y,(5Zu6) 2 Y 5€) in L8(0,T; H), 

Jim žal; Inat) = 2(5€) in LR(2;C((0, T]; H)). 


Hence, in view of (3224), we find that 
Jim X446 = $(t;C) strongly in L4 (2; H), 
Jim Yn InG = y(t; C) strongly in L*. (Q; H), 
Jim YniIn¢ =Y (t;¢) strongly in L2(0, T; H), 
dim Esa. = d(t;C) strongly in L4 (2; H). 
According to ([ELZ3U) and (£2233), we obtain that 
X(t-)0—$(56), Y(t-)G = y(t), 
Y(t)c-Y(50, Xe, N= 260). 
Also, from the equality (IEZZIN) and noting (LZZ34), we find that 
ROX + B*Y + D*Y —0, for ae. (t,w) € [0,T] x R. 
Combining ([3232) and (7-234), we get that 
Jim Xn ¿InG = X(t,-)¢ strongly in L3- (9; H), 
Jim Yn InG = Y(t,-)¢ strongly in L3- (Q; H), 
Jim YDG = Y(4-)C strongly in L2(0, T; H), 


lim aac = X(t, -)¢ strongly in LE, (9; H). 
n—oo 


(13.231) 


(13.232) 


(13.233) 


(13.234) 


(13.235) 


(13.236) 
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Moreover, from Lemma [L.49, it follows that 


X, Y, X € L$(0; C([0, T]; £2(H:; Hy), 














(13.237) 
Y € Lp(2; L?(0, T; L2(H; H»))) 
and 
lim X,-—X in Le(2Q;C((0, T]; C3(H; Ay))), 
lim Yn =Y in L2(£2; C([0, T]; C3(H; Ay))), 
— (13.238) 
lim Y,=Y in L£(2; L?(0, T; £4(H; Ay))), 
n-—-oo 
lim X,—X  inLi(Q9;C([0, T]; £2(H; H»))). 
Step 2. In this step, we shall prove that 
X(t,-)X(t,-)'! 2I Vt € [0,T], as. (13.239) 


For any 6, p € H and t € [0,7], by Itó's formula, we have 


t 
0 


2 | ((C« + DnOn)n(r; In¢); ds (n; Inp)) gj, dW (7) 








+f (Galt Td), | An —BnOn4 (Gy Dn@n) | & (riz) y, dr 
-f (& (rs Da0), (Cn + DnOn)  &(r; Lap) dW (7) 


t 
2 (Cs + DnOn)ên(r; PsC), (Cn + DnOn) &(ri Pap) y, dr = 0. 
Hence, for every t € [0, T], 


OUS, X s ud) g = (X, (£)I46, [o (t) Psp) g. 
= (& (5 Ing), S (t; Ine) = (In, Inp)g,, as. 


This implies that X, (£)X, (£)" = In, a.s. Namely, for all t € [0, T], 


XD eX wa 


By (02229), (03232) and (13234), for any Ç € H and t € [0, T], 
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542 
in Ay, as. 


X(t, X(t, DKS = S 
Furthermore, it follows from X(t, -), X(t,-) € £(H), a.s. that 
in H, a.s., 


X(t, JX(t, J^ =¢ 
which implies (E239). 


Step 3. Put 


Ir) = ¥()X()*, 
AC) = I1() - PO(CQ + DEC). 


From (E237), it follows that X(-)* € L2(0; C([0, T]; £3(H^; H))). This, to- 
gether with (C7240), implies that 


P() = Y()XC)*, 
(13.240) 


P(-) e L(0; C([0, T]; £2 (H3; Ay), 
(13.241) 
A(-) € ERU, T; £a CHT H3). 
Put 
P,(-) m ¥n(-)Xn(-)", I) = Y«4()X4()', 
(13.242) 
An(-) = Tp,(-+) = Pri(-)(Ca(-) + Dn(-)On(-))- 
Similar to the proof of (ELE) and (ILS), we can show that 
P,(t) = P,(t)', as, Wt € [0,7], 
(13.243) 
An(t,w) = An(t,w)", (t,w) € (0,T) x 9. 
It follows from Lemma L329 that 
Jim. [Xp — X*lzscoicqo rica rtm) 
"E (13.244) 
= lim [Xn — X|rstaicqo yea (ii) = 0 
m. [Ys — Ylsco;oqo;rses anm» = 9 (13.245) 
and 
im. [Ys — Y rico mies orn) = 0 (13.246) 


Now, by (32400), (15-242) and (IEE224)-(IE248), we deduce that 
(13.247) 


Jim [Pn — Plrzto;qoryca aru) = 9 
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and 
Jim |An — Al ra(orrieo rn) = O- (13.248) 


Combining (IEZZT7), (T3249) and (IEZZT3), we obtain that 
P(t,w) = P(t,w)*, 
a.e. (t,w) € (0, T) x 2. (13.249) 
A(t,w) = A(t,w)", 
By Itó's formula, and noting (IL227)-(IEL223), we obtain that 
dP, = ( — [AT Yn + CT Yn + MnXn] Xp 


+¥nXq![(Cn + DnOn)? — An — BnOn] - Y.X; (C, + Dn On) at 





4 hese =X o D,6,) dW (t) 





= { Al Pa— Cit IL, — Mn+ Pa[(Cn-+ Dr@n)? — An — BnOn! 
-Ip (Cn + DnOn) bat + [I], — Pa(Cn + DnOn)|dW(t). 


Hence, by (242), (P,(-), An(-)) solves the following R”*"-valued backward 
stochastic differential equation: 





dP, = —[PrAn + Aj Pn + AnCn + C, An + C, Pan 

+(P By + C, Pa Dn + AnDn)On + My] dt 

+A,dW (t) in [0, T], 
PT) = Gn. 


(13.250) 


For k € L5 (2; H3), ux € LACQ, L(t, T; H3)) and vy € LẸ(Q; L?(t, T; 
H5)) (k = 1,2), denote by z,(-.) and 29(-) respectively the mild solutions 
to the equations (IELLLTZ3) and (ILLT3A). For k = 1,2, let us introduce the 
following stochastic differential equations: 


day o = (Ank n du, )dr- (Cr tkjn+Vkn) dW (r) in ft, T], 
(13.251) 
Trn lt) = £a. 
where ug; = Intk, Ukn = Ivy and £y, = L nék Clearly, 
lim kn =€ in L (05 H5), 
lim ug, — ux in Le(Q;L°(t,T; H5)), (13.252) 


lim 9&4 —vy in Lg: EA (t T; H1). 
n—- Co 
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From Lemma and (3-252), for k = 1,2, we get that 
Tim Zenl) = aC) in L4: C (ft T]; H1). (13.253) 
By Itó's formula, and using (I:25U)- (IEZZ5 T), we arrive at 
CERES Ton) H, 
= (P bran Ton) H, + (Patton, Ton) H, + CP dtz n) y, 
+(dPadz1,n, Tan) H, + (ULP. dEn) n. + C Piu dian) H, 
= (—[PrAn + Aj Pr + AnCn + C, An + C, Pr€n 
+(PaBn + On Pa Dn + AnDn)On + Mn] 210; 925) y dr 
+(A nTi,n, 2 n ,dW (r) + (P. (Anzi, + Uia), 22,4) pp dr 
+(Pa(CnX1yn + 1,5), £2 n) g, dW (r) (Pain, Antom + 2,5) pp dr 
(Pai, (Cn2,, + v2 n)) g, dW (r) + (As (Cu, + 01,5); 22,5) y dr 
(A 
(Pn 





+ 
+ (Ch Tin tuU 3) C522, +F Van) dr 
= ( — [(PaBn + Cn Pa Dn + AnDn)On + Mn] 210, 22,5) y dr 


n1, m Cn T2,n + V2,n) g, T" 


HO, U1,n; £2 ig „dr + (Patin 2,5) y dr 

HD, Crnim V2 2) H, dr + CP ti as Catinat von) y, dr 

+(A nU1,n; 22,n) g. dr 4- (Anti ns Van) g, dr 

A1, 22,4) g dW (r) + (PA (Cs 21,5 + 01,5), 22,5) gi, dW (r) 
(Pin; (Cr®2,n + v2,4)) „dW (r). 

This implies that, for any t € [0, T], 





T 
E(Gazias(T), x24 (T)) n, +E f (Ma(r)ma (T), 22, (7)) y, dr 














T 
+E | ([P. (7) B. (7) + Cn(r)" P. (7)Ds (7) + An(7)Dn()] 
XO, (r)vyan (T); v2, (7)) y, dT 


T 
I (Pr(t)urn(T), £2,n(T)}) y, dT (13.254) 




















Ie»! 








= E(P. (t), Ean) p. + 








T 
n(T)*1,n T), Uan(T)) y dr 
T 








T 














(Pa(r)muat 
(Pa (T)Cn(T)£1,n(T), v, (T)) y dT 
(Pa(r)vrn( 


T)U1,n(T), Cn(T)£2,n(T) + van(T)) aT 





af 
t 
+ af 
t 
af 

t 
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T T 
«f (An (T), (7); 22,5 (7)) gj, dr- Bf (An (7) (7); va, (7)) y d7. 


Step 4. In this step, we derive some properties of P and A. 


Let t € [0,T) and y € L} (Q;H). Consider the following forward- 
backward stochastic evolution equation: 


dz‘(r) = (A+ BO)s'dr + (C+ De)z'dW(r) in (t,T], 
dy‘ (r) = —(A*y’ + C*Y* + Mz*)dr + Y'aW (r) in [t T), (13.255) 
a'(t) 2m y'(L) =Ga'(T). 





By Theorems and ELIU, we deduce that (E255) admits a unique mild so- 
lution (z'(),y*C) Y*())( = (s(n) vim 2°50) € 2; C(t, T]; H)) 
xL2(0; C([t, T]; H)) x LZ(t, T; H) such that 


t t t 
I(x (v CY ()) rato;eqe mary £3 (0:0 cerit < CInlzz. (o: 
(13.256) 
For every r € |t, T], define two families of operators X5. and Yt on L4 (Q; H) 
as follows: A " 
Xna (rg) Yen Ey (nin) 
For a.e. r € |t, T], define a family of operators Y'(r) on L4 (2; H) by 
A 
Y'(r)n£Y'(rin). 


It follows from (L32580) that for any r € [t, T] and y € D (0; H), 


[Xml ra. (0.1) <Clnlrz, (a.m): 
[Venlo (2:4) = CInlza. (0:17 (13.257) 
IY* C)nlzz (rn < CInlza. (o: 
This indicates that for every r € [t, T], 
X; € £(Lz, (0; H); Lo (03H), Yi. € L(L%,(Q; H); L5, (02; H)) 


and 
Y'(-) € L(L} (Q; H); Lg (t, T; H)). 


By (217%) and (13-255), it is easy to see that, for any C € H, 
XPX(t)¢ = a' (ri X(t)¢) = &(r; C). 


Thus, 
YiX(06 = y(t; X(t)C) = Y(t)G 
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and 
Y'(r)K(0c = Y (T; XAO = Y(T), for a.e. 7 € [tT]. 


This implies that 
yt = Y(t)X(t)* for all t€ [0, T], a.s., (13.258) 
and 
Y'(r)- Y(r)X(t) for a.e. t € [0,7], 7 € [t, T], a.s. (13.259) 


Further, the inequality (IZZA) implies that for all t € [0,T] and 7 € 
L3 (2; H), 








n 




















Yinlz < CE|n| r, (13.260) 
where C is independent of t € [0, T]. According to (Z260), we find that 





V(X)" lez qo: 13, (9) SC (13.261) 


Thus, from (03-240), (3258) and (£3261), it follows that, for some positive 
constant Cp, 


IP(t)leaz. (or ii (m) SC Vte [0,7]. (13.262) 
We claim that, 
IPs € Co, Vte[0,T], as. (13.263) 
Otherwise, there would exist £o > 0 and 2 € F, with P(Q) > 0 such that 
|P(t,w)lecH) > Co + £0, for a.e. w € Q. 


Let {7x }?21 be a dense subset of the unit sphere of H. Then, for a.e. w € Q, 
there is an n, € (mx]$2., such that 


£0 


E 
|P(t,w)nula => |P, wea — A > Co + 5 


Write 


= € 
M = {we 9 | IPC o)mlu > IPQ wlean - 3) 
€ n 
5 0 
2; = {we B| |P, wnli > PE wean - S (U 9). 
k=1 
for j = 2,3,--- 


Since P(t,w)n; € L%,(Q;H) for all j € N, we see that {Q;}9, C JF; and 


P(f?) = Y ^ P(Q;). Hence, 
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oo € 
[P605 xen, 2 Co for a.e. w € Q. 
J= 


Therefore, 





m 














P(t, w) xs, > (Co A ofA). 
j=1 


On the other hand, it follows from (E3262) that 





























E Pw) Y xan, < CE xan =C >> P(Q) 
j=l j=l j=l 
= C2P(22). 








The above two inequalities contradict each other. Hence, (13263) holds. 
Since the constant Co (in ([L262)) is independent of t € [0,7], it holds 
that 
|P(t,w)| eon) < Co, for a.e. (t,w) € (0, T] x 2. (13.264) 


Similar to the proof of (E262), we can show that for any 1 € L4, (£2; H3), 
IP(t)l ec. (21); L3. (8,H1)) € C. 
Then, similar to the proof of (3-264), we obtain that 
|P(t, w) lec) <C, for a.e. (t,w) € [0, T] x R. (13.265) 
From (3-235), it follows that 
RO-B'P4D'I —0, ae. (t,w) € [o,T] x 0. (13.266) 
This, together with (3262), (IELZü3) and (AS3), implies that 
D'II € t(H;U)n Y4(H3;U). (13.267) 
According to (320), (267) and (AS3), it holds that 
D*A = D'II — D*P(C + DO) e T;(H;U) n T;(H5;U). (13.268) 
From (IEEZZ49J) and (3-268), we see that 
AD € T4(U; H) NA T(U; H1). (13.269) 


Step 5. In this step, we prove that a variant of (73135) holds. We shall 
do this by taking n — oo in (T3254). 


Denote by U' the dual space of U with respect to the pivot space U. From 


(AS3), (BZ), GZA) (C248) and (03-253), we obtain that 
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n— 00 


T 
lim E | ([Pa(t)Bn(r) + Cs (7) Pa(t)Dn(r) 


As (T) Ds (7)] O. (T)zi, (T), T2 n(T)) H dr 


n 














P (13.270) 
=E f (PBO + COPD) 
+4(7)D(T)] O(r)ai(T), va(7)) p, we dr. 
By (02248) and (3-253), we see that, for k = 1,2, 
RT |An C) C) = CG rere, 
E um. [As C Cos CO i nC) E 
HME) = AOO oron (13.271) 


Sm OI rato, ca rtt) Ik) = viC ratos tory) 
+ lim | An C) = AC rst res my) lk C) raton coris) = 0. 


By (IECZZI])- (2270), using a similar argument for other terms in (3254), 
we can take n — oo on both sides of this equality to get that 


























T 
E(Ga4 (T), xo(T)) p + J (M (r)ai (7), 22 (7)) ydr 














T 
FE |J ([P(7) B(r)-C(7)* P(r) D(r)-- A(7)*D(r)] O(r)ai(T), v» (r)) ny gy dr 


























T 
- E(P(061 62) p, gi, + J (ux (7), P(T)" za(7)) qs i, dr (13.272) 




















T T 
+E / (P(r)mi(), ux(7)) gu, m dr-E J (PEJO etr) aat) a dr 








T 
4E | (P(r)n (7), C()as(r) + va(7)) p, y, dr 





























- T 
4 J (A(r)gs(r), vi (7)) i, y, dr + J (A(r)m(r), vx()) i, y dr. 


Noting that P(t) € £(L7- (0; H); L}, (2; H)), we have 


























T 
EC P(t)EL, 62) i, gi, is Ji (n (7), PCr)" 027) gg, dr 




















T T 
«f (P(rym (7), ux(7)) we dr |J (P(r)C(Gr)m (7), vo(7)) q, y, dr 














T 
«f (P(r)vi(r), C(r)@2(7)  v(7)) a, a, dT (13.273) 
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T 
-E(P()6. 6), +B | (ux), P(r)*a2(r)) dr 




















T T 
«f (P(rym (7), ux(7)) a, m dr J (P(r)C(r)a (7), va(7)) dr 
m 
+ J (P(r)u(r), C(r)z2(7) + v2(T)) ydr. 














From (E269) and noting again P(t) € £(L*- (2; H); L4 (Q; H)), we obtain 
that 














T 
J ( [P(r)B(7) + C(T)* P(r)D(7) + A(r)D(r)] O(T)oi(T), £2 (7) gir dt 














T 
J ([P()B(7) + C()! P(7)D() + A(7)D(7)]8(7)m (7), @2(7)) yar- 


(13.274) 
Combing (IL272)- (IEL274), we conclude that 


























t" 
5(Gei(T),20(T))n +E | (M()si er) (7) utr 














T 
«f ([P(r) B(r -C(7)' P(r)D(r)- (7)' D(7)]O(r)aiv(7), v2(7)) dT 


T 
= E(P(t)&1, 62) y + J (P(r)ux(7), zxa(7)) dr 


























(13.275) 
T T 
«f (P(r)a (r), us(7)) ydr + J (P(r)C(r)ai(7), va(7)) dv 
T 
+ f (P(r)ui(7), C(T)£2(T) + v2(T)} dv 


















































T T 
+ f (A(r)ui (7), 22(7)) p, a dT + J (A(r)m(r), va(7)) py ae dr- 


Step 6. In this step, we prove that a variant of (T3136) holds. 

For any & € L?- (2; H), ux € Lg(t, T; H) and vy € Lg(t, T;U) (k = 1,2), 
denote by z,(.) and z3(.) respectively the mild solutions to the equation- 
s (IELLT3) and (ILLI). We can find six sequences {€{}%, € LS (9; H3), 
{ues C LE((; LP (f T; H^Y) and [urs Cia i T, U)), such that 


lim &=& in L4 (Q; H), 
jroo 


lim uj, =u, in L2(t,T;H), 
j—900 


(13.276) 


lim vj =v; in T2070). 
joo 
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Denote by x (-) (resp. z(-)) the mild solution to the equation (0 L3 LES) iem 
(ILE) with £1, u; and vi ve £5, Ug and v2) replaced by &, uj and vj 
(resp. £2, uj, and v3), and by Ty the solution to ([EZZ5T) with £54, Uk,n and 
vi. replaced respectively by 15,62, Mu}, and Dv]. It follows from (E122) 
that 


























(Gard Tris), +B | (Malet rend m) dr 


n 














T 
+ f ( [Pa (T)Bn (T) + Cn (T)! Pn (T) D (T) + An(T)Dn (7)] 
xO,.(r at at js $2 s (7)) OF (13.277) 


























(POE Bn + BL KPC a), Dvd), 

(P, rud Gr) 2d), (Dd C) id) y 

(Ps) Ds (rl (7), Cal) th u(t) + Da (r)vd(r) gp, 

(Ds (rir). An (723 s (7), + (An (rd al), Du Cr) (0) dr. 


From Assumption (AS3) and (Z0), for k = 1,2 and j € N, we have 
that 


n 


lim D(4-)* Au Jel nC) = D6 AAC, Jah.) in Li (0 L(t, T; U^). 


n—oo 














n—oo 


T . 
ii Bf (Ds (r)vi (7), Anla (7), dr 


















































* (13.278) 
=E I (vi (T), D(T)* A()a$(7))g gdr. 
By (03258), we see that D* Az? € L2(t, T; U). Hence, 
li eer D(r)* A(r)zi d 
im E vj (T), D(r)* A(7)23(7)) « «,dr 
Jim. d (0 Ar) er) anon 
-E f (vi (T), D(T)* A(v)as(r)) pdr. 
Similarly, 
i ae a j j 
jim lim E f (An (r)mi (7). Da (7)v2 , (7)) yp dr T 














T 
_ J (D(rY A()m(r), va(7)), dr. 
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Noting that P(t) € C(L. (0; H); L}, (2; H)), we have 
Jim. POE e in DL(O H) 
'Thus, we get that 


lim E(P(t) 1562) n, n = lim E(P(t)£], &) y = E(P (t)r, €2) y 


joo joo 






































Since P(-) € Y3(H), we see that 
lim P()z) = P()z; in L2(t,T; H). 


joo 


Consequently, 


























T /— . T ; 
lim J (ut (7), P(r)g$(7)) a, a, dr = lim Bf (ui (T), Peale) ydr 


joo : a UT 
= J (ux (7), P(r)za(7)) ydr = Ji (P(ryus (7), z2(7)) dr. 


By (IEZZT9)-(IELZSU) and a similar proof of (3-135), we can get that 


















































T 
E(Ga (T), xo(T)) p + J (M (r)ai (7), 2(7)) dr 














T 
+ |J ([PC)BG) + C(7) P(r)D(r) + (7)D(7)]8(7)oi(7), va(7)) dT 


























T 
= E(P(t)E1,€2) y +4 J (P(r)ui(7), x2(7)) dr (13.281) 








ES 

















T T 
+E | (Pm) t) dr +B | (PG) GG), DD) dr 














T 
Ji (P(r)D(r)u(r), C(r)va (7) 4- D(r)va(7)) ydr 





























T T 
8E f (nir) Dr) AG)ms()udr +B | GA) (n). sr), dr. 
t t 
Step 7. In this step, we prove that the assertion 1) in Definition 
holds. We first show that 
K>0, ae. (t,w) € [0,7] x 2. 


Let us replace the vı in (2133) and v2 in (IELT34) by Dv; and Duz, respec- 
tively. 
From (E3268), we see that 


0 = B*P + D* [A+ P(C + DO)| + RO 
= B*P + D* PC + D*A + KO. 





(13.282) 
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Thus, 





PB+C*PD + AD — —G* K*. (13.283) 
Thanks to (2281) and (E283), and noting K(-)* = K(-), we obtain that 


























T 
E(Gz (D), vo(T)) a+ Bf (M(r)a1(r), @2(7)) ydr 














T 
— |J (O(r)* K(r)O(r)a(7), za(7)) dT 


























T 
= E(P(t)&, £2) y + J CP(rya(r),s(r)) ydr (13.284) 




















T T 
+ Ji (P(r)ai(7), ua(7)) ydr + Ji (P(r)C(r)m (7), D(7)va(7)) ydr 





T 
+E f (P(r)D(r)u (T), C(r)zo(T) +D(r)v2(r)) 4d 





























T T 
«f (vi(7), D(r)* A()m(7)) dr + Ji (D(7)* A(r)ai(7), va(7)) dr. 


For any t € (0, T), n € L7 (0; H) and u(-) € L(0, T; U), choose & = € = 
n, uj; = u2 = Bu and v4 = v2 = Du in (IECET3)-(IELT34]). Similar to the proof 
of (13143), thanks to (IEZZEZ), and noting (IELTN) and (23283), we can show 
that 




















Lu ) 
1 T 
=5 E dd ((KOzx, Ox) 7-2 Kez, u)p + (Ku, u)v) dr] 
1 T 
= ;E( e( l Mat f K (u — Ox), u — 02), dr). (13.285) 
Hence, 





E(P(0)j, n)a = J (m G()2C)) € JG uC)), Yul) € Lgl, T; UV), (13.286) 











1 
2 
if and only if 

K>0, ae. (t,w) € [0, T] x R. 


Put 
ijs {(t,w) € (0, T) x Q | K(t,w)h = 0 for some nonzero h € U} 


and 
Uy = (60) € (0, T) x 2 | IK (t o)h|u > 0 for all h € Bu}, 


where By 2 {h € U | |hly = 1}. 
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Clearly, £4 N Ue = Ø and Ly UM, = (0, T) x (2. By the definition of U2, we 
see that 
u 1 
w= LJ { (tw) € (0,T) x Q | |K(t,w)hly > — for all h € Buh. 
m 
m=1 


Let Bf, be a countable dense subset of By. Then 


UW = U { (t,w) € (0,7) x 2 | | K (t, )h|u > E for all h € B) 
r : (13.287) 
=U N (eem x» [Ion > =}. 
m-—1 heBe, 


Since K(-,-)h € L2(0, T; U), we get that, for any h € U, 
1 
{ (t,w) € (0,T) x Q | |K(t,w)hly > | € F. 


This, together with (287), implies that Uo € IF. So does W. 


We now show that K > 0 for ae. (t,w) € [0, T] x 2. Let us use the 
contradiction argument and assume that this were untrue. Then the measure 
(given by the product measure of the Lebesgue measure on [0, T] and the 
probability measure P) of U would be positive. 

For a.e. (t,w) € Lh, put 


Y(t,w) £ (h € By | K(t,w)h = 0). 
Clearly, Y(t,w) is closed in U. Define a map F : (0, T) x (2 — 2" as follows: 
Y(t,w), if (t,w) € Lh 
F(t,w) = 
0, if (t, w) € $5. 
Then, F(t,w) is closed for a.e. (t,w) € (0, T) x R. 
We now prove that F is F-measurable. Let O be a closed subset of U and 
Oı = ON By. Put 
Xy 2 (6,0) € (0,T) x 2| F(t,w) NO #0}, 
p (13.288) 
X2 = {(t,w) € (0,T) x 2 | F(t, w) N O1 #0}. 


Clearly, X1 D Xə. Moreover, 


SzU, if0cO, 
a 


3s. if 0d O. 
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Write 
Xs 2 {(t,w) € (0, T) x 2 | |K(t,w)h|v > 0 for all h € 01}. 


Clearly, X2 N X3 = Ý and (0, T) x (2 = XU Xs. Similar to the above (for the 
proof of UW € IF), we can show that X3 € F. Hence, X € F, and therefore so 
does 34. 

Before continuing, let us recall the following known measurable selection 
result (e.g. [334]). 
Lemma 13.51. Let (2, F) be a measurable space. Let F : (2,7) > 2” bea 


closed-valued set mapping such that F(@) 40 for every © € N, and for each 
open set O C H, 


F-0)2 (o e 2| F(z)noz0i e. 


Then F has a measurable selection f : ie H, i.e., there is an H -valued, 
F-measurable function f such that f(@) € F(@) for every o € Q. 


Now we apply Lemma [LEA to F(-,-) with (£2, F) = ((0, T) x Q,F) to find 
an F-adapted process f such that 


Kf =0 forae. (t,w) € (0, T) x 2. 
Noting that 
|f/(t,w)|u € 1 for ae. (t,w) € (0, T) x Q, 
we find that f € L2(0, T; U). Furthermore, we have 


|f(t,w)|u — 1 for ae. (t, c) € U, 


which concludes that |f] r2(9,r;u > 0. 


By (IEEZ8À3), we see that OZ+ f is also an optimal control. This contradicts 
the uniqueness of the optimal control. Hence, 


K(t,w) is invertible for a.e. (t,w) € [0, T] x 2, 


(but K(t,w)-! does not need to be bounded). 
Further, we show that the domain of K (t,w)^! is dense in U for a.e. (t,w) € 
[0, T] x 2. Denote by R(K (t,c)) the range of K (t, w). Clearly, R(K(t,w)) C U. 
Put 
£ 2 {(t,w) € (0,7) x 2 | R(K(tw))+ 2 {0}} 


and 
fy 2 {(t,w) € (0, T) x 2 | R(K(t,w))+ = (0) ). 


Clearly, f U fh = (0, T) x 2. By the definition of ils; we see that 
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My = U {(t,w) €(0,T) x 2 | Vh € BD, there is an h € BP, such that 


(Kt wh yu | > L 


Then 


=í) U U (es )e 0,7) x 0 | (oh e| > —). (13.289) 


heBO, heBy, m=1 
Since K(-,-)h € L2(0, T; U), it follows that, for any h,h € U, 
- 1 
{(t,w) € (0,T) x Q | |(K(t,w)h, hu | > =} € F. (13.290) 


From ((3289) and (C3290), we see that Uy € F. Hence, Uy € F. 
It suffices to prove that R(K(t,w)) is dense in U for a.e. (t, c) € (0, T) x 2. 
To show this, we use the contradiction argument. If R(K (t,w)) were not dense 
in U for a.e. (t,w) € (0, T) x 2., then the measure of fı would be positive. 
For a.e. (t,w) € Sh, put 


T(t,w) = ( € By | (K(t,w)h,h)y 20, Vh e U}. 


Clearly, T(t,w) is closed in U. 
Define a map F : (0, T) x R — 2" as follows: 


- Y( us), if (t,w) € 1h 
F(t,w) = » 
0, if (t, w) € flo. 


Then, F(t,w) is closed for a.e. (t,w) € (0, T) x Q2. 
We now prove that F is F-measurable. Similar to (13-288), put 


5, 2 {(t,w) € (0,T) x 0 | F(t,w) NO z 01, 
552 {(t,w) € (0,7) x 2 | F(t,w) n 01 4 0). 


If 0 € O, then Si = 35 UL. If 0 ¢ O, then xs = Xy Hence, we only need to 
show that Xs € F. Write 


se { (tw) €(0,T)x 2 | Vh € Oi, there is an h € B? so that 
(K(t,w)h, jy > o}. 


Then, (0,T) x 2 = xx U 35 and Sa N 35 — (). Hence, it suffices to show that 
X3 € F. Let Oo be a countable dense subset of O4. Clearly, 
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{ (tw) €(0,T)x 2 | Vh € Oj, there is an h € BP, such that 


e 
i 
Ce 


HG 


(K(t,w)h, h)u > L1) (13.291) 


{ (tw) €(0,T) x 2 | V h € Op, there is an h € B9, such that 


i 
TCCH 


n 


(K(tu)h, kv > LY 


m 


U {(t.0) € 0,7) x 2] (K (t,u)h, lu > È}. 
heBe, 


T 
ics 


1heOo 


For any m € N, h € Oo and h € BD, noting that K(-,-)h € L2(0, T; U), we 
deduce that 


{ (tw) € (0,T) x Q | (K(t,w)h, hju > J EF. (13.292) 


From (329) and (C5292), it follows that X4 € F. Hence, X € F. 
Now we apply Lemma LII to F(-,-) with (2, F) = ((0, T) x (2, F) to find 
an F-adapted process f such that 


(K(t,w)h, f(t,w))y 20, Vh €U, ae. (to) € (0,T) x 2. 
Since : 
|f(t,c)|u € 1 for ae. (t,w) € (0,T) x 2, 
it holds that f € L2(0, T; U). Furthermore, we have 


|f(t,w)|u =1 for ae. (tu) € Sh, 


which implies that |f Ira (o,rsv) > 0. 


_ We claim that Oz + f is also an optimal control. Indeed, by the choice of 
f, it holds that 


T A 
: (K(u— 62 — f), f dr = 














and 


























T 7 7 T 7 
Ji (Kf,u-98- Par =E | (f,K(u-— Oz- I) deu. 


Therefore, for any u(-) € L2(0, T; U), 

















T 
J (K (u Oz — f),u— OZ Pydr 
E (13.293) 














T 
= ef (K(u — Oz), u — Oz), dr 
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According to (2285) and (£3293), we obtain that 
J(mO()2C) +f) € Imu), Yul) € LC, T; U), 


which indicates that Oz + f is also an optimal control. This leads to a contra- 
diction to the uniqueness of the optimal controls. Hence, K (t, 0)! is densely 
defined in U for a.e. (t,w) € (0, T) x R. 

Now, let us prove that K(t,w)~! is a closed operator for a.e. (t,w) € 
(0, T) x 2. Let (9;)3£4 C D(K(t,w)-!), p € U and f € U satisfy 


lim pj 2 pinU (13.294) 
joo 
and 
lim K(t,w) !pj; = pin U. (13.295) 
joo 


From ([EEZ93), we obtain that 


lim p; = K(t,w)p  inU. 
jroo 
This, together with (£294), implies that p = K(t,w)p. Consequently, p € 
D(K(t,w) 1) and K(t,w)~!p = f. This indicates that the operator K(t,w)~! 
is closed. Therefore, the assertion 1) in Definition holds. 
By (ILLZE2), we find that 


— K-!(B*P-4- D*A4-D*PO) = 8. (13.296) 


This implies (IEZT37). Moreover, from (32), (T5284) and (IELZ98), we see 
that the assertions 2) and 3) in Definition holds. 


Step 8. In this step, we prove the uniqueness of the transposition solution 
to (T1). 

Assume that (Pi(-),A1(-)), (P3), 43()) € Crw((0, T]; 2° (2; £(H))) x 
Lẹ „(0,T;C(H)) are two transposition solutions to (ILZTZ). Similar to the 
proof of (L142), we can obtain that 














af ((Mz(r),2(7)) 4 + (Ru(r),u(r)),,)ar + (Gz(T),2(T)) | 








» («n (t)n, Hg + f (Ki(u — Ox), u — Oz), dr) (13.297) 

















NlR NIe 


E((Pa(t)n, Nis + [ (Ko(u — Or)u-— 02), dr), 


where K; = R+ DPjD for j = 1,2. 
By taking u = Oz in (£2297), we get that for any t € [0, T) and ņ € 
L7. (£2; H), 


























E(P: (t)n, n)a = E(PY(t)n, mn. (13.298) 
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Thus, for any 6,7 € L*- (2; H), we have that 














E(Pi(t)(n + €),n + ja = E(Po(t)(n + £5 m £), 


and 


























E(Pi(t)(n — €),n — €) = E(Po(t)(n — £m - n 
These, together with P,(-) = P1(-)* and P2(-) = P2(-)*, imply that 
E(P: (t)n, €)4 =E(Po(t)n,é)H, | V& me LÊ (Q; H). (13.299) 


Hence, P(t) = P(t) for any t € [0, T], a.s. 
Let € = & = 0, u, = 0 and v = 0. By (IELI33), we see that for any 
ug € Lg(2; L?(0, T; H1)) and vı € L4(Q; L?(0, T; H4)), 














T 
0-E | (v (7), (41(r) = 427) #207) gs p, dr. 
which implies that 
(Ai — Az)za — 0 in LE (0; (0, T; Hy). 


This, together with Lemma LCI, concludes that A; = Az in L2(0, T; £3(H5; 
H))). Consequently, the desired uniqueness follows. Li 


13.9 Some Examples 

In this section, we shall give two illuminating examples for LQ problems gov- 
erned respectively by stochastic wave and Schródinger equations. One can 
also consider LQ problems for other controlled stochastic partial differential 
equations. We leave it to interested readers. 


Throughout this section, n € N and O C R” is a bounded domain with a 
C™ boundary 9Ó. 


13.9.1 LQ Problems for Stochastic Wave Equations 

Consider the following controlled stochastic wave equation: 
dy, — Aydt = biudt + (ay + bou)dW(t) in O x (0, T), 
y=0 on O x (0, T), (13.300) 
y(0)— yo w(0)—13 in O, 


with the cost functional 
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T 
agea ^ 
Femi SE | f Gf e raza +B | atur) fas. 
0 





Here (yo, y1) € Hi (O) n D?(O), u € L2(0, T; L?(O)), 


eee e LPO,T;C"O)), (13.301) 


gELE(Q;0°7(O)), | q20,rz1, gz 0. 





Our optimal control problem is as follows: 


Problem (wSLQ). For each (yo, y1) € Hj(O) x L?(O), find ü(-) € L2(0, T; 
L?(O)) such that 


I (yo, y1; (-)) = inf J (yo, y1; u(-)). (13.302) 


= n 
u(-) € L2(0,T;L2(0)) 


Problem (wSLQ) is a concrete example of Problem (SLQ) in the following 
setting: 


e H = H¿(O) x L?(O) and UJ (9, 


e The operator A is defined as follows: 


D(A) = [H? (0) n Hg(O)] x Hə (0), 


qi | 2 1 . 
(e) (2). (e) «no 


e Bu= (0, biu)! , C(y, yi)! = (0, ay)" and Du — (0, bau) ' ; 
e The operators M, R and G are given by 


(Qs). Gi) u = f Uu lf 
(fu uy, = | rl dz, 
(GT) (D) GIC) (D) = fol uD)? lC) ya 


Since q > 0, r > 1 and g > 0, we have that Problem (wSLQ) is uniquely 
solvable. 


Define an operator A as follows: 
pas ase 


Ap=—Ay, WE D(A). 


560 13 Linear Quadratic Optimal Control Problems 


Denote by (À; )524 the eigenvalues of Â and (6;)j&., the corresponding eigen- 





si 
vectors with |é;|r2(o) 1 for j € N. Clearly, { + id? hx are the eigen- 


values of A and {(+ Êj; 





> 





oo 
|)! are the corresponding eigenvectors. It 
j=l 





1 oo 
is well known that {( -arij &)} constitutes an orthonormal basis of 


j 
Hà(O) x L? (O). Hence, (AS1) holds. 

Denote by Hy the completion of the Hilbert space Hj(O) x L?(O) with 
the norm 


(fis flin = Y I^ (L5 + Ufa; l?); 


ge 


for all fı = Ya 2e; CHAO) and fy = Yo fase eP O). 


By the asymptotic distribution of the eigenvalues of A (e.g., [297, Chapter 1, 
Theorem 1.2.1]), we see that 


ed T T 
DTP =o (#44; hejes) E teje) A 
e 2» lj" « oo 


Hence, the embedding from Hj(Q) x L?(O) to Hy is Hilbert-Schmidt. From 
the definition of Hj, it follows that H5 = D(A”). 


Let a € C?” (O). For any f € Hi, one has 








&. 
ll 
n 


lafla; = le fipias) = |A” (of) nitoyxza(o) 
< |a|can@ylflD(ar) = lo] can qo f |a; - 
From this, we conclude that C € LẸ (0, 7; £(H3)), G € LE (Q; £(H3)) and 
M € Lg? (0, T'; C(H3)). Thus, (AS2) holds. 
Let U = D(A”). Clearly, U is dense in L?(O). From the definition of B, 


D and R, we find that R € L£*(0, T; £(U)) and B, D € L2(0, T; C(U; H?)). 
Therefore, (AS3) holds. 


13.9.2 LQ problems for Stochastic Schródinger Equations 


In this section, we consider the LQ problem for the following controlled s- 
tochastic Schródinger equations: 
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dy — iAydt = byudt + (ay + b3u)aW (t) in O x (0,7), 
y-0 on ôO x (0,T), (13.303) 
y(0) — yo in O, 


with the following cost functional 























T 
Torn) 28 | [ (auf? rust E | gy) Pas. 
0 O O 





Here yo € L? (O), u € L2(0, T; L?(O)), and the coefficients fulfill (Z300). 
Our optimal control problem is as follows: 


Problem (sSLQ). For each yo € L?(O), find a ü(-) € L2(0, T; L?(O)) such 
that 


J (yo; u(.)) = inf J (yo; u(-)). (13.304) 


X w()€ L2(0,73L2(0)) 


Problem (sSLQ) is a concrete example of Problem (SLQ) in the following 
setting: 


e HaV=aL (0); 
e The operator A is defined as follows: 
D(A) = H2(0) n H4(O), 
Ap =iAy, Vy € D(A); 
e Bu= bu, Cy = ay and Du = bou; 
e The operators M, R and G are given by 


(My.u)a = | aluPae. (Ruuju = | luf. 
O o 


(GUT) aC) = | aly(T) Pac. 


Since q > 0, r > 1 and g > 0, Problem (sSLQ) is uniquely solvable. 
Write {1;}52, for the eigenvalues of A and {e;}72, the corresponding 
eigenvectors with |e;|z2(0) = 1 for j € N. It is well known that {e,}72, 


constitutes an orthonormal basis of L?(O). Hence, (AS1) holds. 
Denote by H, the completion of the Hilbert space L? (O) with the norm 


fli, = Mug "DP, foral f =X fie; e L7(O). 
j=l j=l 
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By the asymptotic distribution of the eigenvalues of A (e.g., BJA, Chapter 1, 
Theorem 1.2.1]), we see that 


oo 


Ham) = 5 (ej ej) Hx = 4M |u;| ^ < oo. 
j=l 


j=l 
Hence, the embedding from L?(O) to Hy is Hilbert-Schmidt. From the defi- 
nition of Hj, it follows that H5 = D((iA)"/?). 

Let a € C?” (O). For any f € Hi, one has 


lof | nr; = la f| p(iAy/2) = IGA) (o f| 22(0) 
€ lelezs (oy floa) = leles of lay 
From this, we conclude that 
CeLg(0T;£(H), GeL£Z.(0;£(H,), M e Lg (0, T; £(H)). 


Thus, (AS2) holds. 


Let U = D((iA)"). Clearly, U is dense in L?(O). From the definitions of 
B, D and R, we find that 


R€ LẸ (0,T;£L(Ū)), B,D € LRC, T; £(U; H5)). 


Therefore, (AS3) holds. 


13.10 Notes and Comments 


Unless other stated, the material of this chapter is mainly based on [243]. 
Other works that are related to this chapter can be found in [23, rA, L50, 235], 
etc. 

LQ problem for (deterministic) finite dimensional systems is one of the 
three milestones in modern control theory and has been extensively studied 
for different kinds of control systems. It is fundamentally important due to 
the following reasons: 


e It can be used to model many problems in applications; 
e Many optimal control problems for nonlinear control systems can be rea- 
sonably approximated by LQ problems. 


To our best knowledge, the deterministic LQ problem was first studied in 
[22]. In [163], the optimal feedback control was found via the matrix-valued 
Riccati equation, and hence a systematic LQ control theory was established. 
This theory was extended to infinite dimensions as well (e.g., [[85, 202). 

LQ problems for stochastic finite dimensional systems were first studied 
in EZ] by means of the dynamic programming method. In [B5T, B52], Riccati 
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equation was first introduced to study LQ problems for stochastic differen- 
tial equations with deterministic coefficients. The LQ problems for stochastic 
differential equations with random coefficients were first studied in [BZ], in 
which a matrix-valued nonlinear backward stochastic differential equation in 
the form of (LZA) was derived. These works have inspired many new pro- 
gresses and applications on LQ problems for stochastic differential equations 
(e.g., B3, 236, 285, B07, BUS, BT3] and the rich references cited therein). 

Compared with LQ problems for stochastic differential equations, there 
exist only a quite limited number of works dwelling on some special cases of 
LQ problems for stochastic distributed parameter systems (e.g., (2, 76, C30, 
E, (134), 52, 233, BIS]). We list below some of these typical works: 


e In [I52, BIH], Problem (SLQ) was studied under the condition that the 
diffusion term in (T) is specialized as Ca(t)dW (t)+Du(t)dW2(t), where 
Wi(-) and W2(-) are mutually independent Brownian motions. With this 
assumption, the corresponding Riccati equation reads 


dP — —[P(A + Ai) + (A A)! P-C*PC € Q 
—PBK B*Pjdt in[0,T), (13.305) 


which is a random operator-valued Riccati equation (rather than operator- 
valued backward stochastic Riccati equation). 

e In P], under the assumption that the diffusion term in (IELT) is edW (t) 
with o being a suitable F-adapted H-valued process independent of both 
the state and the control, Problem (SLQ) was studied and the optimal 
feedback control was obtained by solving a random operator-valued Ric- 
cati equation (similarly to (IL305)) and a backward stochastic evolution 
equation. 

e In [130], Problem (SLQ) was considered for the case that R = Iy, the 
identity operator on U, and D = 0. In this case, the equation (IET) is 
specialized as 


dP =—(PA+ A*P+AC+C*A+C*PC+Q 
—PBB* P)dt + AdW (t) in[0,T), (13.306) 
P(T) =G. 


Although (306) looks much simpler than (1%), it is also an operator- 
valued backward stochastic evolution equation (because the “bad” term 
*AdW(t)" is still in (IEL3UG)). Nevertheless, [E30] considered a kind of 
generalized solution to (306), which was a “weak limit” of solutions to 
some suitable finite dimensional approximations of (306). A little more 
precisely, it was shown in [L30] that the finite dimensional approximations 
P, of P are convergent in some weak sense, and via which P may be ob- 
tained as a suitable generalized solution to the equation (IEL3U8) although 
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nothing can be said about A (to the same equation). This is enough for 
the case that D = 0 since the corresponding optimal feedback operator in 
(ILL T3N) is then specialized as 


o()-2-K() BQ'PQ, 


which is independent of A. 

e In [I31], the well-posedness of (3300) was further studied when A is a 
self-adjoint operator on H and there exists an orthonormal basis festa 
in H and an increasing sequence of positive numbers [jj], so that 
Ae; = —pjej for j € N and 2554 Hj. < œ for some r € (1. 3). Clearly, 
this assumption is not satisfied by many controlled stochastic partial differ- 
ential equations, such as stochastic wave equations, stochastic Schródinger 
equations, stochastic KdV equations, stochastic beam equations, etc. It is 
even not fulfilled by the classical m-dimensional stochastic heat equation 
for m > 2. The well-posedness result (in [L31]) for (3300) was then ap- 
plied to Problem (SLQ) in the case that R = Iy and D — 0. 


In this chapter, we do not assume that R = Iy and D = 0. If D = 0, 
then the nonlinear term L* K-1L is specialized as PBB* P, which enjoys a 
“good” sign in the energy estimate, and therefore, it is not very hard to 
obtain the well-posedness of the linearized equation of (IZI, at least for 
some special situation. Once the well-posedness of this linearized equation is 
established, the well-posedness of (L41) follows from a fixed point argument 
(e.g. [L30, C31). However, if D Æ 0, it is not an easy task even to derive the 
well-posedness of the linearized version of (17). 

In order to study the well-posedness of (IEZT7), we introduce a sequence of 
finite dimensional approximate equations, and prove that the limit of the solu- 
tions for these approximate equations is the transposition solution to (LZA). 
To this end, we need to assume that A generates a Co group on H. As pointed 
out in Remark (£243, this assumption can be dropped (See [235]). However, 
we keep the use of the present method due to the following two reasons: 


e This method is rather elementary and provides an intrinsic connection be- 
tween the well-posedness of (LZA) and the forward-backward stochastic 
evolution equation ([:EZI/). Consequently, it shows the relationship be- 
tween the Pontryagin-type maximum principle (Theorem and Corol- 
lary (33) and the optimal feedback operator. 

e It provides a numerical scheme to compute the solution to (IELT7). Of 
course, since the convergence is very weak, it is not easy to compute the 
numerical solution to (17) by this method. However, as far as we know, 
so far it is the only existing convergent numerical scheme. 


There are many open problems related to the main topic of this chap- 
ter. We shall list below some of them which, in our opinion, are particularly 
interesting: 


1) Control systems with unbounded control operators. 
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As we have pointed out in Remark B], In this paper, we assume that both 
B(-) and D(-) are bounded operator-valued process. As a result, the system 
(IIT) does not cover controlled stochastic partial differential equations with 
boundary/pointwise controls. To drop this restriction, one needs to make some 
further assumptions, such as the semigroup (S(t)h;zo has some smoothing 
effect. When D = 0, some results along this line are obtained (e.g. [I34]). On 
the other hand, when D # 0, there is no published result in the literature. We 
believe that one can combine the transposition methods introduced in Section 
and this chapter to deal with that case. But several technical difficulties 
should be overcome. 


2) LQ problems with incomplete state information. 


In this chapter, we only consider LQ problems with complete state in- 
formation. When the control system is only partially observed, that is, what 
we know is only z = Oz + £, where O is a suitable operator and £ is the 
observation noise. LQ problems for partially observed stochastic differential 
equations are extensively studied (e.g. [22, B39]). However, as far as we know, 
except for some very particular case, such as the coefficients are deterministic 
and the noise is additive, there exist no results for LQ problems of stochastic 
distributed parameter systems with incomplete state information. 
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